-- Logs begin at Wed 2021-02-17 02:40:45 UTC, end at Wed 2021-02-17 03:53:37 UTC. -- Feb 17 03:18:00.368688 dv-cinder-759943-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 17 03:18:00.376530 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 17 03:18:00.378587 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: *** Starting uWSGI 2.0.15-debian (64bit) on [Wed Feb 17 03:18:00 2021] *** Feb 17 03:18:00.378587 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Feb 17 03:18:00.378587 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Feb 17 03:18:00.378587 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: nodename: dv-cinder-759943-5-iscsi Feb 17 03:18:00.378587 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: machine: x86_64 Feb 17 03:18:00.378587 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: clock source: unix Feb 17 03:18:00.378587 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: pcre jit disabled Feb 17 03:18:00.378587 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: detected number of CPU cores: 4 Feb 17 03:18:00.378587 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: current working directory: / Feb 17 03:18:00.378587 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: detected binary path: /usr/bin/uwsgi-core Feb 17 03:18:00.378587 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: dropping root privileges as early as possible Feb 17 03:18:00.378587 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: your processes number limit is 47843 Feb 17 03:18:00.379589 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: your memory page size is 4096 bytes Feb 17 03:18:00.379589 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: detected max file descriptor number: 2048 Feb 17 03:18:00.379589 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: lock engine: pthread robust mutexes Feb 17 03:18:00.379589 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: thunder lock: enabled Feb 17 03:18:00.379589 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 17 03:18:00.379589 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: dropping root privileges after socket binding Feb 17 03:18:00.379589 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Feb 17 03:18:00.424601 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: Python main interpreter initialized at 0x5589178bb9c0 Feb 17 03:18:00.424601 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: dropping root privileges after plugin initialization Feb 17 03:18:00.424601 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: python threads support enabled Feb 17 03:18:00.424601 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: your server socket listen backlog is limited to 100 connections Feb 17 03:18:00.424601 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: your mercy for graceful operations on workers is 90 seconds Feb 17 03:18:00.425105 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: mapped 402621 bytes (393 KB) for 2 cores Feb 17 03:18:00.425105 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: *** Operational MODE: preforking *** Feb 17 03:18:00.425278 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: dropping root privileges after application loading Feb 17 03:18:00.425278 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: *** uWSGI is running in multiple interpreter mode *** Feb 17 03:18:00.425278 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: spawned uWSGI master process (pid: 83238) Feb 17 03:18:00.425431 dv-cinder-759943-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 17 03:18:00.425956 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: spawned uWSGI worker 1 (pid: 83239, cores: 1) Feb 17 03:18:00.426765 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: spawned uWSGI worker 2 (pid: 83240, cores: 1) Feb 17 03:18:00.426765 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 17 03:18:04.843231 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 03:18:04.843766 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 03:18:04.845065 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 03:18:04.845492 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 03:18:04.845620 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 03:18:04.845782 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 03:18:04.845888 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 03:18:04.846234 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.846599 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.846957 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.847326 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.847426 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 03:18:04.847692 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.847839 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 03:18:04.848040 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.848143 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 03:18:04.848396 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.848551 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.848732 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.848881 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.849130 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.849239 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.849427 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.849583 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.849790 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.849937 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.850161 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759943-5-iscsi {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.850261 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.850531 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.850621 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.850874 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.851022 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.851226 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.851349 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.851561 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.851703 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.851905 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.852039 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.852272 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759943-5-iscsi {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.852422 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.852612 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.852728 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.852966 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.853247 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.853415 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.853595 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.853734 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.853941 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.854091 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.854289 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.854434 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.854648 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.854789 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.855004 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.855262 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.855899 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.856127 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.856272 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.856474 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.856621 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.856823 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.856963 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.857219 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.857360 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.857570 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.857701 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759943-5-iscsi {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.857918 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.858056 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.858610 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.858733 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.859052 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.859200 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.859430 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.859569 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.859781 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.859934 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.860151 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759943-5-iscsi {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.860307 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.860485 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.860601 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.860836 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.860981 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.861199 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.861317 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.861577 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.861730 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.861939 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.862079 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.862336 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.862492 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.862630 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.862763 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.862957 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.863095 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.863315 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.863473 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.863609 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.863749 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.863967 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.864113 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.864371 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.864545 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.864694 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.864829 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.864968 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.865123 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.865258 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.865404 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.865611 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.865757 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.865974 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.866114 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.866310 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.866459 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.866613 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.866750 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.866893 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.867033 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.867178 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.867314 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.867532 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.867679 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.867882 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.868022 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.868224 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.868363 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.868509 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.868644 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.868777 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.868913 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.869100 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.869239 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.869473 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.869623 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.869825 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.869965 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.870162 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.870381 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.870590 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.870727 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.870861 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.871001 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.871687 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.871834 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.871969 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.872104 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.872311 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.872529 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.872674 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.872820 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.872992 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.873136 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.873441 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.873588 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.873733 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.873880 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.874055 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.874196 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.874420 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.874559 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.874772 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.874919 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.875134 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.875274 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.875470 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.875610 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.875813 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.875958 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.876153 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.876299 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.876504 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.876649 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.876862 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.877007 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.877225 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.877365 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.877499 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.877633 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.877821 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.877966 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.878163 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.878317 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.878547 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.878700 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.878845 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.878980 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.879155 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.879294 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.879429 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.879568 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.879756 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.879901 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.880097 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.880242 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.880462 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.880617 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.880758 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.880897 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.881052 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.881188 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.881399 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.881548 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.881737 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.881876 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.882072 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.882217 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.882406 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.882578 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.882787 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.882925 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.883058 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.883191 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.883375 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.883534 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.883734 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.883871 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.884004 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.884137 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.884342 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.884489 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.884673 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.884812 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.885044 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.885181 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.885375 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.885515 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.885710 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.885849 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.886052 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.886191 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.886382 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.886527 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.886740 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.886887 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.887094 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.887233 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.887430 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.887570 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.887762 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.887902 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.888119 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.888259 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.888447 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.888593 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.888779 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.888932 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.889160 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.889309 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.889503 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.889648 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.889838 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.889978 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.890168 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.890318 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.890579 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.890727 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.890861 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.890995 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.891136 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.891279 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.891461 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.891600 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.891797 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.891937 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.892130 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.892277 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.892468 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.892613 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.892832 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.892978 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.893147 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.893294 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.893474 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.893613 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.893831 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.893977 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.894119 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.894260 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.894453 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.894591 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.894815 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.894953 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.895159 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.895304 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.895499 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.895636 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.895839 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.895988 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.896203 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:18:04.896347 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.896551 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.896696 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.896900 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.897057 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.897277 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.897416 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.897632 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.897769 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.897974 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.898119 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.898320 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.898463 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.898666 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.898814 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.899011 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.899157 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.899355 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.899493 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.899716 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.899853 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.900063 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.900208 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.900403 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.900548 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.900765 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.900903 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.901064 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.901200 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.901422 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.901643 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.901788 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.901930 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.902122 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.902747 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.902969 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.903117 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.903326 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.903468 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.903675 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.903820 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.904029 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.904173 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.904373 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.904519 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.904730 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.904870 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.905111 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.905255 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.905451 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.905594 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.905800 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.905940 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.906147 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.906286 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.906501 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.906650 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.906841 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.906981 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.907179 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.907328 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.907535 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.907675 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.907882 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.908032 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.908221 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.908361 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.908557 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.908696 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.908897 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.909063 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.909276 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.909428 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.909638 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.909779 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.909980 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.910108 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.910326 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.910443 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.910670 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.910888 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.911011 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.911131 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.911325 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.911443 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.911674 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.911815 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.912368 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.912466 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.912559 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.912652 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.912652 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.912833 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.912976 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.913179 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.913351 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.913451 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.913700 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.913800 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.914083 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.914200 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.914371 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.914471 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.914703 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.914803 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.915046 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.915145 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.915383 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.915487 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.915718 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.915818 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.916062 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.916162 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.916408 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.916507 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.916744 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.916844 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.917104 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.917210 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.917446 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.917556 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.917789 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.917894 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.918701 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.918810 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.919045 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.919158 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.919402 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.919507 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.919745 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.919850 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.920105 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.920212 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.920455 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.920554 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.920802 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.920920 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.921168 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.921293 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.921512 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.921611 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.921851 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.921949 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.922193 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.922299 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.922534 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.922638 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.922876 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.922974 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.923210 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.923354 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.923540 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.923639 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.923873 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.923971 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.924210 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.924347 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.924545 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.924644 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.924891 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.924986 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.925259 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.925356 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.925595 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.925690 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.925924 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.926020 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.926259 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.926354 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.926601 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.926695 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.926949 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.927044 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.927288 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.927383 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.927628 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.927745 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.927968 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.928074 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.928307 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.928406 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.928646 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.928745 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.928986 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.929149 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.929351 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.929451 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.929698 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.929804 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.930056 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.930162 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.930388 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.930487 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.930734 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.930834 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.931067 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.931187 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.931404 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.931524 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.931750 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.931855 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.932110 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.932216 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.932447 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.932545 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.932786 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.932885 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.933152 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.933256 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.933522 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.933627 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.933885 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.933984 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.934254 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.934409 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.934576 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.934676 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.934911 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.935016 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.935258 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.935358 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.935598 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.935703 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.935936 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.936042 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.936278 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.936378 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.936610 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.936709 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.936946 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.937088 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.937315 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.937414 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.937657 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.937805 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.937995 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.938102 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.938334 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.938433 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.938669 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.938773 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.939016 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.939122 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.939362 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.939461 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.939704 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.939802 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.940038 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.940148 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.940379 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.940478 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.940737 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.940835 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.941099 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.941212 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.941701 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.941811 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.942041 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.942140 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.942380 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.942487 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.942724 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.942822 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.943081 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.943180 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.943421 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.943526 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.943755 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.943853 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.944098 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.944239 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.944437 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.944537 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.944785 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.944884 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.945158 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.945269 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.945494 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.945595 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.945848 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.945946 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.946192 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.946291 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.946532 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.946637 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.946870 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.946969 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.947211 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.947325 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.947550 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.947651 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.947895 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.947993 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.948237 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.948347 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.948583 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.948682 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.948924 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.949050 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.949348 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.949461 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.949691 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.949791 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.950030 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.950134 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.950383 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.950489 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.950723 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.951072 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.951170 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.951421 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.951526 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.951771 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.951889 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.952119 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.952217 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.952467 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.952572 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.952822 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.953192 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.953290 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.953567 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.953683 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.953919 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.954012 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.954260 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.954355 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.954608 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.954720 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.954941 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.955047 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.955283 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.955381 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.955629 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.955735 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.955968 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.956068 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.956303 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.956402 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.956636 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.956743 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.956975 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.957103 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.957339 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.957437 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.957679 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.957846 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.958015 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.958118 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.958347 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.958446 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.958683 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.958790 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.959015 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.959114 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.959356 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.959455 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.959689 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.959795 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.960021 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.960120 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.960363 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.960467 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.960694 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.960794 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.961061 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.961164 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.961386 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.961485 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.961722 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.961834 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.962090 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.962200 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.962427 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.962532 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.962770 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.962875 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.963112 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.963210 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.963452 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.963551 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.963808 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.963908 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.964153 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.964253 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.964487 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.964587 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.965360 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.965471 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.965710 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.965820 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.966053 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.966165 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.966393 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.966493 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.966740 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.966839 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.967073 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.967180 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.967411 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.967510 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.967747 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.967846 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.968085 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.968192 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.968416 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.968516 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.968758 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.968863 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.969138 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.969250 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.969475 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.969574 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.969813 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.969912 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.970152 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.970252 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.970487 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.970586 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.970826 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.970924 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.971160 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.971259 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.971501 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.971600 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.971832 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.971931 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.972171 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.972272 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.972504 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.972602 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.972836 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.972940 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.973210 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.973312 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.973564 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.973664 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.973906 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.974005 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.974244 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.974343 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.974579 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.974677 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.974911 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.975016 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.975250 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.975348 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.975588 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.975689 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.975929 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.976039 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.976262 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.976361 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.976592 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.976690 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.976925 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.977051 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.977285 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.977393 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.977620 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.977718 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.977967 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.978074 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.978320 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.978463 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.978635 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.978741 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.978966 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.979073 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.979300 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.979430 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.979642 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.979744 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.979990 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.980090 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.980328 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.980966 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.981253 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.981363 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.981596 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.981697 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.981940 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.982039 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.982294 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.982393 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.982633 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.982732 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.982992 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.983092 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.983338 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.983437 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.983685 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.983790 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.984019 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.984123 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.984363 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.984462 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.984696 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.984795 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.985065 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.985167 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.985401 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.985509 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.985754 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.985856 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.986095 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.986201 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.986437 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.986545 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.986769 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.986867 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.987114 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.987218 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.987454 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.987566 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.987790 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.987889 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.988135 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.988219 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.988483 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.988589 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.988816 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.988920 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.989178 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.989281 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.989526 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.989634 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.989871 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.989976 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.990207 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.990306 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.990547 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.990649 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.990886 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.990990 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.991224 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.991323 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.991557 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.991656 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.991895 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.992000 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.992240 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.992339 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.992575 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.992676 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.992913 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.993010 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.993277 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.993391 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.993616 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.993721 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.993956 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.994054 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.994295 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.994418 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.994635 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.994735 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.994982 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.995080 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.995321 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.995428 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.995667 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.995766 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.996027 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.996131 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.996378 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.996486 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.996727 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.996828 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.997086 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.997189 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.997522 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.997633 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.997871 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.997972 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.998209 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.998308 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.998556 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.998661 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.998893 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.999010 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.999225 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.999329 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.999566 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.999698 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:04.999934 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.000072 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.000274 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.000379 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.000616 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.000715 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.000956 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.001068 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.001326 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.001427 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.001662 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.001761 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.002022 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.002141 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.002364 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.002463 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.002708 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.002806 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.003050 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.003149 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.003416 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.003538 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.003759 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.003858 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.004124 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.004222 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.004544 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.004654 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.004911 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.005010 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.005286 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.005385 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.005630 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.005740 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.005983 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.006084 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.006329 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.006428 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.006693 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.006799 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.007061 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.007159 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.007408 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.007506 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.007743 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.007842 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.008075 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.008180 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.008416 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.008515 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.008778 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.008877 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.009152 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.009254 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.009513 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.009611 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.009877 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.009976 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.010219 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.010317 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.010590 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.010695 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.010955 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.011061 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.011297 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.011395 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.011653 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.011764 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.011997 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.012138 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.012341 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.012508 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.012682 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.012858 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.013022 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.013250 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.013409 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.013619 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.013725 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.013963 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.014063 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.014305 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.014404 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.014654 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.014755 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.014996 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.015096 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.015326 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.015429 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.015686 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.015790 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.016019 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.016118 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.016361 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.016459 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.016701 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.016808 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.017088 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.017192 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.017401 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.017499 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.017743 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.017853 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.018100 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.018198 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.018434 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.018532 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.018763 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.018872 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.019101 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.019199 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.019438 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.019536 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.019802 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.019955 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.020133 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.020232 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.020488 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.020585 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.020829 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.020935 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.021195 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.021296 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.021539 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.021639 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.021881 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.021981 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.022268 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.022366 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.022610 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.022708 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.022964 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.023071 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.023320 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.023424 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.023658 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.023758 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.023996 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.024095 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.024344 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.024442 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.024681 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.024791 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.025018 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.025135 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.025379 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.025477 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.025724 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.025831 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.026058 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.026165 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.026385 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.026494 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.026722 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.026821 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.027056 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.027165 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.027921 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.028025 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.028267 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.028375 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.028605 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.028755 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.028937 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.029097 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.029311 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.029411 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.029645 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.029745 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.030012 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.030116 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.030347 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.030447 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.030707 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.030807 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.031054 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.031152 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.031387 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.031486 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.031730 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.031836 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.032072 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.032172 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.032430 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.032541 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.032776 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.032880 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.033148 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.033256 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.033489 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.033604 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.033841 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.033941 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.034193 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.034292 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.034534 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.034640 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.034883 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.034982 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.035225 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.035324 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.035570 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.035670 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.035911 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.036016 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.036257 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.036361 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.036612 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.036837 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.036936 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.037234 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.037335 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.037616 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.037731 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.037959 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.038059 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.038303 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.038403 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.038647 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.038757 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.038999 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.039235 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.039334 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.039601 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.039708 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.039977 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.040110 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.040320 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.040418 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.040660 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.040769 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.041007 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.041186 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.041385 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.041485 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.041735 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.041845 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.042080 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.042179 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.042427 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.042526 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.042772 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.042898 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.043664 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.043765 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.044034 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.044193 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.044403 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.044504 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.044777 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.044876 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.045147 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.045261 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.045508 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.045614 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.045855 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.045953 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.046204 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.046318 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.046553 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.046653 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.046902 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.047001 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.047251 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.047359 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.047609 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.047707 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.047957 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.048062 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.048299 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.048399 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.048648 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.048748 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.048993 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.049110 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.049371 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.049471 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.049723 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.049822 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.050078 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.050210 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.050425 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.050525 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.050768 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.050867 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.051109 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.051216 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.051459 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.051693 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.051833 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.052044 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.052218 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.052418 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.052578 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.052786 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.052928 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.053178 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.053291 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.053532 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.053638 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.053884 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.054211 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.054310 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.054546 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.054653 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.054889 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.054988 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.055235 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.055334 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.055583 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.055684 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.055925 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.056023 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.056271 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.056396 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.056617 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.056717 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.056950 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.057067 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.057317 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.057417 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.057658 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.057757 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.057998 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.058264 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.058363 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.058689 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.058802 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.059032 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.059131 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.059375 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.059477 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.059736 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.059837 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.060085 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.060183 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.060433 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.060693 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.060803 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.061114 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.061217 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.061460 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.061559 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.061816 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.061924 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.062163 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.062263 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.062504 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.062608 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.062843 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.062950 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.063182 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.063282 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.063527 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.063631 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.063865 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.063971 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.064203 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.064302 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.064539 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.064664 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.064876 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.064982 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.065244 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.065345 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.065587 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.065686 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.065928 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.066028 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.066530 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.066659 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.066875 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.066974 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.067208 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.067308 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.067539 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.067637 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.067877 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.067982 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.068212 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.068311 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.068541 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.068639 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.068883 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.068988 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.069245 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.069346 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.069583 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.069681 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.069917 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.070024 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.070257 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.070356 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.070597 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.070696 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.070930 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.071036 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.071274 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.071374 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.071609 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.071708 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.071949 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.072056 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.072286 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.072385 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.072633 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.072733 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.072971 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.073101 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.073344 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.073444 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.073683 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.073782 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.074026 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.074151 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.074405 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.074676 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.074775 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.075057 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.075368 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.075485 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.075591 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.075737 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.075844 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.076125 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.076232 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.076463 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.076570 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.076808 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.077088 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.077203 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.077472 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.077574 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.077832 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.077932 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.078178 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.078285 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.078524 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.078633 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.078869 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.078980 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.079213 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.079371 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.079551 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.079659 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.079896 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.079995 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.080239 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.080346 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.080577 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.080676 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.080919 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.081019 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.081306 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.081413 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.081654 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.081754 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.082001 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.082109 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.082342 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.082442 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.082687 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.082787 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.083028 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.083127 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.083370 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.083471 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.083716 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.083815 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.084064 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.084162 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.084409 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.084509 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.084764 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.084868 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.085128 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.085255 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.085470 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.085577 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.085810 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.085944 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.086158 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.086265 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.086507 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.086615 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.086857 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.086961 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.087233 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.087340 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.087584 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.087682 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.087927 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.088027 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.088310 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.088420 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.088677 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.088776 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.089017 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.089142 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.089379 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.089480 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.089718 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.090324 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.090575 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.090675 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.090952 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.091058 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.091326 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.091425 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.091680 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.091779 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.092015 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.092116 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.092357 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.092456 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.092698 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.092797 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.093088 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.093201 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.093469 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.093581 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.093777 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.093888 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.094122 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.094221 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.094476 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.094576 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.094834 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.094941 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.095180 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.095279 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.095518 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.095617 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.095857 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.095965 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.096198 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.096303 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.096540 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.096638 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.096873 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.096962 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.097248 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.097359 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.097594 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.097701 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.097936 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.098046 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.098302 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.098400 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.098643 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.098742 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.098992 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.099101 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.099329 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.099428 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.099675 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.099775 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.100015 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.100115 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.100359 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.100459 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.100714 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.100813 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.101093 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.101197 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.101442 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.101543 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.101787 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.101887 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.102134 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.102240 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.102475 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.102575 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.102845 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.103212 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.103564 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.103664 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.103910 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.104016 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.104283 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.104389 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.104629 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.104728 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.104977 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.105139 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.105404 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.106305 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.106682 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.106781 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.107045 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.107143 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.107402 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.107510 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.107755 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.107854 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.108108 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.108214 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.108479 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.108579 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.108824 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.108929 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.109207 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.109309 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.109558 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.109659 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.109908 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.110007 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.110276 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.110380 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.110625 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.110725 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.110993 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.111092 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.111338 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.111444 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.111697 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.111797 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.112049 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.112155 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.112402 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.112511 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.112754 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.112853 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.113131 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.113247 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.113508 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.113622 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.113802 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83240) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 03:18:05.113906 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.114218 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.114591 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.114982 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.115337 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.115727 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.116103 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:18:05.116381 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83239) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 03:18:05.230297 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_db.sqlalchemy.engines [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83240) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:18:05.231628 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_db.sqlalchemy.engines [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83239) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:18:05.489275 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.context [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb2942c0-ebf7-43c0-b475-e153b195efa7(cell1) {{(pid=83240) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 03:18:05.489909 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.context [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb2942c0-ebf7-43c0-b475-e153b195efa7(cell1) {{(pid=83239) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 03:18:05.494772 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:18:05.495379 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83239) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:18:05.496697 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:18:05.497270 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83239) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:18:05.497604 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:18:05.498150 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83239) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:18:05.499715 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:18:05.500255 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83239) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:18:05.526595 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_db.sqlalchemy.engines [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83240) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:18:05.528549 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_db.sqlalchemy.engines [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83239) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:18:05.536112 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_db.sqlalchemy.engines [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83240) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:18:05.537926 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_db.sqlalchemy.engines [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83239) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:18:05.561243 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_db.sqlalchemy.engines [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83240) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:18:05.562377 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_db.sqlalchemy.engines [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83239) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:18:05.658856 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 03:18:05.658856 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: from cryptography.utils import int_from_bytes Feb 17 03:18:05.659161 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 03:18:05.659161 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: from cryptography.utils import int_from_bytes Feb 17 03:18:05.659345 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 03:18:05.659345 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: from cryptography.utils import int_from_bytes Feb 17 03:18:05.659521 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 03:18:05.659521 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: from cryptography.utils import int_from_bytes Feb 17 03:18:05.734947 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO keyring.backend [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] Loading Gnome Feb 17 03:18:05.735105 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO keyring.backend [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] Loading Gnome Feb 17 03:18:05.755309 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO keyring.backend [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] Loading Google Feb 17 03:18:05.755437 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO keyring.backend [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] Loading Google Feb 17 03:18:05.758501 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO keyring.backend [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] Loading Windows (alt) Feb 17 03:18:05.758615 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO keyring.backend [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] Loading Windows (alt) Feb 17 03:18:05.763623 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO keyring.backend [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] Loading file Feb 17 03:18:05.763751 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO keyring.backend [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] Loading file Feb 17 03:18:05.764719 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO keyring.backend [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] Loading keyczar Feb 17 03:18:05.764810 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO keyring.backend [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] Loading keyczar Feb 17 03:18:05.765196 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO keyring.backend [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] Loading multi Feb 17 03:18:05.765321 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO keyring.backend [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] Loading multi Feb 17 03:18:05.766044 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO keyring.backend [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] Loading pyfs Feb 17 03:18:05.766153 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO keyring.backend [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] Loading pyfs Feb 17 03:18:06.043857 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: WARNING keystonemiddleware.auth_token [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 03:18:06.044421 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: WARNING keystonemiddleware.auth_token [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 03:18:06.050987 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: WARNING keystonemiddleware.auth_token [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 03:18:06.051572 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: WARNING keystonemiddleware.auth_token [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 03:18:06.381444 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: WARNING keystonemiddleware.auth_token [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 03:18:06.382810 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: WARNING keystonemiddleware.auth_token [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 03:18:06.387270 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: WARNING keystonemiddleware.auth_token [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 03:18:06.388636 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: WARNING keystonemiddleware.auth_token [None req-41a30c55-b94c-44fe-b22f-50a6db0e95d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 03:18:06.392609 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5589178bb9c0 pid: 83239 (default app) Feb 17 03:18:06.393996 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5589178bb9c0 pid: 83240 (default app) Feb 17 03:18:06.394920 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:18:06.396127 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-4761ea65-4f3b-4b17-8a11-5c0426f79ced None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001826 Feb 17 03:18:06.396558 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 779 bytes} [Wed Feb 17 03:18:06 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:19:29.785891 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-67f6df58-2569-471a-9dd2-5410f414ac49 admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:19:29.810952 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-67f6df58-2569-471a-9dd2-5410f414ac49 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 15 microversion: 2.1 time: 0.506984 Feb 17 03:19:29.811557 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 1/2] 10.222.0.57 () {58 vars in 1150 bytes} [Wed Feb 17 03:19:29 2021] GET /compute/v2.1/flavors/detail => generated 15 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:32.643715 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-06a73a98-4684-42c3-8c21-8abb35146235 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:32.669526 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:19:32.669526 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: warnings.warn(msg) Feb 17 03:19:32.695509 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-06a73a98-4684-42c3-8c21-8abb35146235 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.395895 Feb 17 03:19:32.696109 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 2/3] 10.222.0.57 () {62 vars in 1183 bytes} [Wed Feb 17 03:19:32 2021] POST /compute/v2.1/flavors => generated 367 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:19:32.707151 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-081fcb90-3690-4c12-a875-f70021041bc5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:32.709312 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:19:32.709312 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: warnings.warn(msg) Feb 17 03:19:32.746422 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-081fcb90-3690-4c12-a875-f70021041bc5 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.043329 Feb 17 03:19:32.747006 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 2/4] 10.222.0.57 () {62 vars in 1236 bytes} [Wed Feb 17 03:19:32 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:32.756981 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-c840a2aa-5e4b-4804-b9bd-359b4e24c43a admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:19:32.773949 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-c840a2aa-5e4b-4804-b9bd-359b4e24c43a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.021010 Feb 17 03:19:32.774503 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 3/5] 10.222.0.57 () {58 vars in 1183 bytes} [Wed Feb 17 03:19:32 2021] GET /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:35.382072 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-08c6336a-9b2c-4f51-83f8-f6fe25f03b96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:35.406553 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:19:35.406553 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: warnings.warn(msg) Feb 17 03:19:35.428374 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-08c6336a-9b2c-4f51-83f8-f6fe25f03b96 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.099333 Feb 17 03:19:35.428974 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 3/6] 10.222.0.57 () {62 vars in 1183 bytes} [Wed Feb 17 03:19:35 2021] POST /compute/v2.1/flavors => generated 364 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:19:35.439968 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-f8cff1d9-c010-450e-bd89-f0f197234bdc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:35.441824 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:19:35.441824 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: warnings.warn(msg) Feb 17 03:19:35.477992 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-f8cff1d9-c010-450e-bd89-f0f197234bdc admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.041912 Feb 17 03:19:35.478680 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 4/7] 10.222.0.57 () {62 vars in 1236 bytes} [Wed Feb 17 03:19:35 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:35.488448 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-29e47143-cf2c-4ac6-a6c8-6e0d9675e41a admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:19:35.503625 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-29e47143-cf2c-4ac6-a6c8-6e0d9675e41a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019127 Feb 17 03:19:35.504187 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1183 bytes} [Wed Feb 17 03:19:35 2021] GET /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:38.041797 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-4a4e1d4c-5cbe-4516-86e2-758eac382a32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:38.063896 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-4a4e1d4c-5cbe-4516-86e2-758eac382a32 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.074767 Feb 17 03:19:38.064493 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 5/9] 10.222.0.57 () {62 vars in 1183 bytes} [Wed Feb 17 03:19:37 2021] POST /compute/v2.1/flavors => generated 364 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:19:38.075486 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-bbe7f282-5cba-43cb-a041-ab4cc0dc16b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:38.110626 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-bbe7f282-5cba-43cb-a041-ab4cc0dc16b9 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.038980 Feb 17 03:19:38.111156 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 5/10] 10.222.0.57 () {62 vars in 1236 bytes} [Wed Feb 17 03:19:38 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:38.120908 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-b8190ae7-7599-426b-b7d0-62918c7ba59e admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:19:38.135981 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-b8190ae7-7599-426b-b7d0-62918c7ba59e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.018945 Feb 17 03:19:38.136529 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 6/11] 10.222.0.57 () {58 vars in 1183 bytes} [Wed Feb 17 03:19:38 2021] GET /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:40.699374 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-e91c666d-bd0a-43c0-b92d-888645cdf6d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:40.720797 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-e91c666d-bd0a-43c0-b92d-888645cdf6d6 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.075738 Feb 17 03:19:40.721438 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 6/12] 10.222.0.57 () {62 vars in 1183 bytes} [Wed Feb 17 03:19:40 2021] POST /compute/v2.1/flavors => generated 364 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:19:40.732335 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-55b04583-0e44-4163-9197-2c30da6c1039 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:40.767684 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-55b04583-0e44-4163-9197-2c30da6c1039 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039304 Feb 17 03:19:40.768212 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 7/13] 10.222.0.57 () {62 vars in 1236 bytes} [Wed Feb 17 03:19:40 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:40.777958 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-cc5ee4b9-923b-4857-8b30-65f46f7796ff admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:19:40.794436 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-cc5ee4b9-923b-4857-8b30-65f46f7796ff admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.020402 Feb 17 03:19:40.794988 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 7/14] 10.222.0.57 () {58 vars in 1183 bytes} [Wed Feb 17 03:19:40 2021] GET /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:43.342230 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-aea9c192-74a2-46cd-9aac-1d2d646ae9d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:43.366026 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-aea9c192-74a2-46cd-9aac-1d2d646ae9d0 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.077046 Feb 17 03:19:43.366621 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 8/15] 10.222.0.57 () {62 vars in 1183 bytes} [Wed Feb 17 03:19:43 2021] POST /compute/v2.1/flavors => generated 364 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:19:43.377384 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-b8ce4125-0217-4968-ab0b-61702ecae7f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:43.411904 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-b8ce4125-0217-4968-ab0b-61702ecae7f6 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.038437 Feb 17 03:19:43.412421 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 8/16] 10.222.0.57 () {62 vars in 1236 bytes} [Wed Feb 17 03:19:43 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:43.422705 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-3b69d68c-ef24-43e8-9228-4f5e3b414f71 admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:19:43.437750 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-3b69d68c-ef24-43e8-9228-4f5e3b414f71 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.018846 Feb 17 03:19:43.438301 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 9/17] 10.222.0.57 () {58 vars in 1183 bytes} [Wed Feb 17 03:19:43 2021] GET /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:46.002118 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-4416e24d-0a64-4b06-af38-c9bd8e35b885 admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:19:46.021360 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-4416e24d-0a64-4b06-af38-c9bd8e35b885 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 1786 microversion: 2.1 time: 0.072376 Feb 17 03:19:46.021933 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 9/18] 10.222.0.57 () {58 vars in 1150 bytes} [Wed Feb 17 03:19:45 2021] GET /compute/v2.1/flavors/detail => generated 1786 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:19:48.568387 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-a825ea05-991a-408a-b4e2-2341a6d03c6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:48.590922 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-a825ea05-991a-408a-b4e2-2341a6d03c6d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 362 microversion: 2.1 time: 0.075926 Feb 17 03:19:48.591508 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 10/19] 10.222.0.57 () {62 vars in 1183 bytes} [Wed Feb 17 03:19:48 2021] POST /compute/v2.1/flavors => generated 362 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:19:48.602152 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-aeb71cc5-a420-49bd-b64e-27de31a643e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:48.637367 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-aeb71cc5-a420-49bd-b64e-27de31a643e4 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039005 Feb 17 03:19:48.637904 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 10/20] 10.222.0.57 () {62 vars in 1233 bytes} [Wed Feb 17 03:19:48 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:48.647457 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-c19b3f67-83a3-463f-b5a3-ff3849b61852 admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:19:48.663192 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-c19b3f67-83a3-463f-b5a3-ff3849b61852 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019507 Feb 17 03:19:48.663749 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 11/21] 10.222.0.57 () {58 vars in 1180 bytes} [Wed Feb 17 03:19:48 2021] GET /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:51.218114 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-2759d09d-96b3-4188-a605-a0091b925889 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:51.240110 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-2759d09d-96b3-4188-a605-a0091b925889 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.075683 Feb 17 03:19:51.240689 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 11/22] 10.222.0.57 () {62 vars in 1183 bytes} [Wed Feb 17 03:19:51 2021] POST /compute/v2.1/flavors => generated 365 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:19:51.251363 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-b8bbacca-b6e4-4d84-80ac-f999ac7a28f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:51.286446 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-b8bbacca-b6e4-4d84-80ac-f999ac7a28f7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.038993 Feb 17 03:19:51.287038 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 12/23] 10.222.0.57 () {62 vars in 1233 bytes} [Wed Feb 17 03:19:51 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:51.297192 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-b60be1dc-26d3-44c0-8fd9-7a57a8b68678 admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:19:51.312117 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-b60be1dc-26d3-44c0-8fd9-7a57a8b68678 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.018711 Feb 17 03:19:51.312668 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 12/24] 10.222.0.57 () {58 vars in 1180 bytes} [Wed Feb 17 03:19:51 2021] GET /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:53.879850 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-0d46128c-97f9-4fc1-ad8d-72c960368f66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:53.902545 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-0d46128c-97f9-4fc1-ad8d-72c960368f66 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.076450 Feb 17 03:19:53.903142 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 13/25] 10.222.0.57 () {62 vars in 1183 bytes} [Wed Feb 17 03:19:53 2021] POST /compute/v2.1/flavors => generated 366 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:19:53.914148 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-03b3080b-cf4a-4fad-8a59-a189663b1177 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:53.949514 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-03b3080b-cf4a-4fad-8a59-a189663b1177 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039222 Feb 17 03:19:53.950059 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 13/26] 10.222.0.57 () {62 vars in 1233 bytes} [Wed Feb 17 03:19:53 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:53.960312 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-69c0d8cc-b4f1-405e-a6f9-2a0e1780106e admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:19:53.976189 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-69c0d8cc-b4f1-405e-a6f9-2a0e1780106e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.020088 Feb 17 03:19:53.976736 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 14/27] 10.222.0.57 () {58 vars in 1180 bytes} [Wed Feb 17 03:19:53 2021] GET /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:56.524486 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-c1121072-26d9-4793-908e-33477b993b69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:56.546373 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-c1121072-26d9-4793-908e-33477b993b69 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.074865 Feb 17 03:19:56.546962 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 14/28] 10.222.0.57 () {62 vars in 1183 bytes} [Wed Feb 17 03:19:56 2021] POST /compute/v2.1/flavors => generated 365 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:19:56.558120 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-de13b825-c364-422b-bad9-be860e6a5429 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:56.593978 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-de13b825-c364-422b-bad9-be860e6a5429 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.040148 Feb 17 03:19:56.594499 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 15/29] 10.222.0.57 () {62 vars in 1233 bytes} [Wed Feb 17 03:19:56 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:56.604158 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-d5267227-46b1-49db-884d-7d5c3fd6707f admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:19:56.619703 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-d5267227-46b1-49db-884d-7d5c3fd6707f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019351 Feb 17 03:19:56.620266 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 15/30] 10.222.0.57 () {58 vars in 1180 bytes} [Wed Feb 17 03:19:56 2021] GET /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:59.156021 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-893b1066-e182-4f62-8f31-35e439ceb32b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:59.177734 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-893b1066-e182-4f62-8f31-35e439ceb32b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 368 microversion: 2.1 time: 0.075350 Feb 17 03:19:59.178321 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 16/31] 10.222.0.57 () {62 vars in 1183 bytes} [Wed Feb 17 03:19:59 2021] POST /compute/v2.1/flavors => generated 368 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:19:59.189702 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-5b8af645-9c03-4163-9ad5-d6bc3b4d5818 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:19:59.224619 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-5b8af645-9c03-4163-9ad5-d6bc3b4d5818 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039006 Feb 17 03:19:59.225251 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 16/32] 10.222.0.57 () {62 vars in 1233 bytes} [Wed Feb 17 03:19:59 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:19:59.235146 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-7ac34659-fc51-42ed-bc8b-ddb4bc34cf5f admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:19:59.250801 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-7ac34659-fc51-42ed-bc8b-ddb4bc34cf5f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019494 Feb 17 03:19:59.251354 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 17/33] 10.222.0.57 () {58 vars in 1180 bytes} [Wed Feb 17 03:19:59 2021] GET /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:21:09.967933 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-84dd34dd-6632-4f25-89ab-994f1015c0f9 admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:09.991594 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-84dd34dd-6632-4f25-89ab-994f1015c0f9 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 3562 microversion: 2.1 time: 0.076792 Feb 17 03:21:09.992173 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 17/34] 10.222.0.57 () {58 vars in 1150 bytes} [Wed Feb 17 03:21:09 2021] GET /compute/v2.1/flavors/detail => generated 3562 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:21:11.636407 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-7ac34659-fc51-42ed-bc8b-ddb4bc34cf5f admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:11.637508 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-7ac34659-fc51-42ed-bc8b-ddb4bc34cf5f admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Feb 17 03:21:11.637942 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 18/35] 10.222.0.57 () {56 vars in 1065 bytes} [Wed Feb 17 03:21:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:21:11.818360 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-7fa969e2-a6e9-4614-aa2f-7e2889df8c0a admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:11.832372 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.wsgi [None req-7fa969e2-a6e9-4614-aa2f-7e2889df8c0a admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 17 03:21:11.833011 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-7fa969e2-a6e9-4614-aa2f-7e2889df8c0a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:21:11.833901 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-7fa969e2-a6e9-4614-aa2f-7e2889df8c0a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.069977 Feb 17 03:21:11.834447 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 18/36] 10.222.0.57 () {60 vars in 1181 bytes} [Wed Feb 17 03:21:11 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 03:21:11.844697 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-8f47ed86-325f-4065-941b-98e6ae113ab1 admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:11.867954 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-8f47ed86-325f-4065-941b-98e6ae113ab1 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.027093 Feb 17 03:21:11.868588 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 19/37] 10.222.0.57 () {60 vars in 1201 bytes} [Wed Feb 17 03:21:11 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:21:11.878980 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-ef3bbec8-f7f4-4a2e-9e36-20198811b24e admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:11.902337 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-ef3bbec8-f7f4-4a2e-9e36-20198811b24e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.027071 Feb 17 03:21:11.902912 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 19/38] 10.222.0.57 () {60 vars in 1201 bytes} [Wed Feb 17 03:21:11 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:21:11.913706 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-68dc1528-7891-4f3e-9343-341d2650e8da admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:11.927741 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.wsgi [None req-68dc1528-7891-4f3e-9343-341d2650e8da admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 17 03:21:11.928374 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-68dc1528-7891-4f3e-9343-341d2650e8da admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:21:11.929906 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-68dc1528-7891-4f3e-9343-341d2650e8da admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.020680 Feb 17 03:21:11.930441 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 20/39] 10.222.0.57 () {60 vars in 1181 bytes} [Wed Feb 17 03:21:11 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 03:21:13.473100 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-ef3bbec8-f7f4-4a2e-9e36-20198811b24e admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:13.474185 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-ef3bbec8-f7f4-4a2e-9e36-20198811b24e admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Feb 17 03:21:13.474616 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 20/40] 10.222.0.57 () {56 vars in 1065 bytes} [Wed Feb 17 03:21:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:21:13.653312 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-8a94fb66-1bc0-4437-b8e4-47815cafdc3f admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:13.668418 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.wsgi [None req-8a94fb66-1bc0-4437-b8e4-47815cafdc3f admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 17 03:21:13.669129 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-8a94fb66-1bc0-4437-b8e4-47815cafdc3f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:21:13.669982 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-8a94fb66-1bc0-4437-b8e4-47815cafdc3f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.070257 Feb 17 03:21:13.670526 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 21/41] 10.222.0.57 () {60 vars in 1181 bytes} [Wed Feb 17 03:21:13 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 03:21:13.681486 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-81418c08-3f13-4028-995e-9d249c65cc1b admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:13.703860 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-81418c08-3f13-4028-995e-9d249c65cc1b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.026809 Feb 17 03:21:13.704368 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 21/42] 10.222.0.57 () {60 vars in 1201 bytes} [Wed Feb 17 03:21:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:21:13.714378 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-03b9f100-a964-4813-b374-84d414a673d4 admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:13.735435 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-03b9f100-a964-4813-b374-84d414a673d4 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.024769 Feb 17 03:21:13.735999 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 22/43] 10.222.0.57 () {60 vars in 1201 bytes} [Wed Feb 17 03:21:13 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:21:13.746297 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-704dbf8a-b27b-4497-8029-43fdf7681af3 admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:13.759437 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.wsgi [None req-704dbf8a-b27b-4497-8029-43fdf7681af3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 17 03:21:13.760045 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-704dbf8a-b27b-4497-8029-43fdf7681af3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:21:13.760884 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-704dbf8a-b27b-4497-8029-43fdf7681af3 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.018363 Feb 17 03:21:13.761426 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 22/44] 10.222.0.57 () {60 vars in 1181 bytes} [Wed Feb 17 03:21:13 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 03:21:15.305935 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-03b9f100-a964-4813-b374-84d414a673d4 admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:15.307067 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-03b9f100-a964-4813-b374-84d414a673d4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Feb 17 03:21:15.307503 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 23/45] 10.222.0.57 () {56 vars in 1065 bytes} [Wed Feb 17 03:21:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:21:15.486019 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-c16f28e5-bf45-400c-aba7-7b654fdc1ce1 admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:15.499306 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.wsgi [None req-c16f28e5-bf45-400c-aba7-7b654fdc1ce1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 17 03:21:15.499917 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-c16f28e5-bf45-400c-aba7-7b654fdc1ce1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:21:15.500816 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-c16f28e5-bf45-400c-aba7-7b654fdc1ce1 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.067680 Feb 17 03:21:15.501429 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 23/46] 10.222.0.57 () {60 vars in 1184 bytes} [Wed Feb 17 03:21:15 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 03:21:15.512206 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-a4fce730-daad-46b3-a0ca-ba6a73588758 admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:15.533741 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-a4fce730-daad-46b3-a0ca-ba6a73588758 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025426 Feb 17 03:21:15.534313 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 24/47] 10.222.0.57 () {60 vars in 1201 bytes} [Wed Feb 17 03:21:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:21:15.544712 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-4926eaa3-41e2-4f42-8ea8-fc924b46d314 admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:15.566224 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-4926eaa3-41e2-4f42-8ea8-fc924b46d314 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025155 Feb 17 03:21:15.567032 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 24/48] 10.222.0.57 () {60 vars in 1201 bytes} [Wed Feb 17 03:21:15 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:21:15.576684 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-8f06b0d6-5d15-4aa5-9e20-445dca028d60 admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:15.589373 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.wsgi [None req-8f06b0d6-5d15-4aa5-9e20-445dca028d60 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 17 03:21:15.589992 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-8f06b0d6-5d15-4aa5-9e20-445dca028d60 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:21:15.590832 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-8f06b0d6-5d15-4aa5-9e20-445dca028d60 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.017870 Feb 17 03:21:15.591370 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 25/49] 10.222.0.57 () {60 vars in 1184 bytes} [Wed Feb 17 03:21:15 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 17 03:21:17.128751 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-4926eaa3-41e2-4f42-8ea8-fc924b46d314 admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:17.129876 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-4926eaa3-41e2-4f42-8ea8-fc924b46d314 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Feb 17 03:21:17.130340 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 25/50] 10.222.0.57 () {56 vars in 1065 bytes} [Wed Feb 17 03:21:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:21:17.310682 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-afadc021-c8c2-4cf4-bf86-143f12959f7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:21:17.333927 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-afadc021-c8c2-4cf4-bf86-143f12959f7f admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.87 time: 0.076522 Feb 17 03:21:17.334498 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 26/51] 10.222.0.57 () {64 vars in 1226 bytes} [Wed Feb 17 03:21:17 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:21:18.868917 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-4926eaa3-41e2-4f42-8ea8-fc924b46d314 admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:18.870018 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-4926eaa3-41e2-4f42-8ea8-fc924b46d314 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Feb 17 03:21:18.870551 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 26/52] 10.222.0.57 () {56 vars in 1065 bytes} [Wed Feb 17 03:21:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:21:19.050261 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-4f23f609-7c8f-490f-9a77-a1b6b814f33a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:21:19.074535 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-4f23f609-7c8f-490f-9a77-a1b6b814f33a admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.87 time: 0.078242 Feb 17 03:21:19.075051 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 27/53] 10.222.0.57 () {64 vars in 1226 bytes} [Wed Feb 17 03:21:18 2021] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:21:20.604763 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-4926eaa3-41e2-4f42-8ea8-fc924b46d314 admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:20.605869 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-4926eaa3-41e2-4f42-8ea8-fc924b46d314 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Feb 17 03:21:20.606303 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 27/54] 10.222.0.57 () {56 vars in 1065 bytes} [Wed Feb 17 03:21:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:21:20.785776 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-54a87bfd-9db9-42b3-ad41-9538003c1ce0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:21:20.810060 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-54a87bfd-9db9-42b3-ad41-9538003c1ce0 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.87 time: 0.077928 Feb 17 03:21:20.810579 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 28/55] 10.222.0.57 () {64 vars in 1226 bytes} [Wed Feb 17 03:21:20 2021] POST /compute/v2.1/flavors => generated 407 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:21:22.364535 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-4926eaa3-41e2-4f42-8ea8-fc924b46d314 admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:22.365710 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-4926eaa3-41e2-4f42-8ea8-fc924b46d314 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Feb 17 03:21:22.366723 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 28/56] 10.222.0.57 () {56 vars in 1065 bytes} [Wed Feb 17 03:21:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:21:22.545574 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-9879cd33-1a7d-43ed-8d69-fa68b982d4cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:21:22.569502 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-9879cd33-1a7d-43ed-8d69-fa68b982d4cb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.87 time: 0.076641 Feb 17 03:21:22.570028 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 29/57] 10.222.0.57 () {64 vars in 1226 bytes} [Wed Feb 17 03:21:22 2021] POST /compute/v2.1/flavors => generated 409 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:21:24.118497 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-4926eaa3-41e2-4f42-8ea8-fc924b46d314 admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:24.119570 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-4926eaa3-41e2-4f42-8ea8-fc924b46d314 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Feb 17 03:21:24.119999 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 29/58] 10.222.0.57 () {56 vars in 1065 bytes} [Wed Feb 17 03:21:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:21:24.298667 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-ed60b5f6-7bdd-4fd1-b4ba-ce058067bfad admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:21:24.328756 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-ed60b5f6-7bdd-4fd1-b4ba-ce058067bfad admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.083282 Feb 17 03:21:24.329349 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 30/59] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Feb 17 03:21:24 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:22:14.618937 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-4926eaa3-41e2-4f42-8ea8-fc924b46d314 admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:22:14.620017 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-4926eaa3-41e2-4f42-8ea8-fc924b46d314 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Feb 17 03:22:14.620452 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 30/60] 10.222.0.57 () {56 vars in 1065 bytes} [Wed Feb 17 03:22:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:22:14.800015 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-3c2fd109-e95e-4301-805c-bafef97b3d9c admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:22:14.828491 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-3c2fd109-e95e-4301-805c-bafef97b3d9c admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.082423 Feb 17 03:22:14.829002 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 31/61] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Feb 17 03:22:14 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:23:36.273704 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-9a63512e-5570-4e7e-b370-94982354d232 tempest-verify_tempest_config-2049400375 tempest-verify_tempest_config-2049400375-project] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:23:36.275763 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-9a63512e-5570-4e7e-b370-94982354d232 tempest-verify_tempest_config-2049400375 tempest-verify_tempest_config-2049400375-project] 10.222.0.57 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.119999 Feb 17 03:23:36.276334 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 31/62] 10.222.0.57 () {58 vars in 1124 bytes} [Wed Feb 17 03:23:36 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:25:12.511613 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-3c2fd109-e95e-4301-805c-bafef97b3d9c admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:25:12.512696 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-3c2fd109-e95e-4301-805c-bafef97b3d9c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001632 Feb 17 03:25:12.513160 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 32/63] 10.222.0.57 () {56 vars in 1065 bytes} [Wed Feb 17 03:25:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:25:12.768191 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-1f2a4e7b-58fe-4c3a-b58b-63de55899c23 admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:25:12.769515 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:25:12.769515 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: warnings.warn(msg) Feb 17 03:25:12.771130 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-1f2a4e7b-58fe-4c3a-b58b-63de55899c23 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:25:12.771663 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-1f2a4e7b-58fe-4c3a-b58b-63de55899c23 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:25:12.772998 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-1f2a4e7b-58fe-4c3a-b58b-63de55899c23 admin admin] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:25:12.773520 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-1f2a4e7b-58fe-4c3a-b58b-63de55899c23 admin admin] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:25:12.806033 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-1f2a4e7b-58fe-4c3a-b58b-63de55899c23 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.164229 Feb 17 03:25:12.806615 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 32/64] 10.222.0.57 () {60 vars in 1184 bytes} [Wed Feb 17 03:25:12 2021] GET /compute/v2.1/os-services => generated 791 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:25:14.364357 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-3c2fd109-e95e-4301-805c-bafef97b3d9c admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:25:14.365487 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-3c2fd109-e95e-4301-805c-bafef97b3d9c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Feb 17 03:25:14.365920 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 33/65] 10.222.0.57 () {56 vars in 1065 bytes} [Wed Feb 17 03:25:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:25:14.550153 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-76eb7105-e1d2-47c6-87eb-b906ccf3adca admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:25:14.551410 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:25:14.551410 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: warnings.warn(msg) Feb 17 03:25:14.552990 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-76eb7105-e1d2-47c6-87eb-b906ccf3adca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:25:14.553517 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-76eb7105-e1d2-47c6-87eb-b906ccf3adca admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:25:14.554364 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-76eb7105-e1d2-47c6-87eb-b906ccf3adca admin admin] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:25:14.554853 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-76eb7105-e1d2-47c6-87eb-b906ccf3adca admin admin] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:25:14.579695 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-76eb7105-e1d2-47c6-87eb-b906ccf3adca admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.084051 Feb 17 03:25:14.580231 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 33/66] 10.222.0.57 () {60 vars in 1184 bytes} [Wed Feb 17 03:25:14 2021] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:25:26.532238 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-3c2fd109-e95e-4301-805c-bafef97b3d9c admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:25:26.533394 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-3c2fd109-e95e-4301-805c-bafef97b3d9c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Feb 17 03:25:26.533835 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 34/67] 10.222.0.57 () {56 vars in 1065 bytes} [Wed Feb 17 03:25:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:25:26.717529 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-1d80af2e-104f-4858-84f8-e53624000c19 admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:25:26.718860 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:25:26.718860 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: warnings.warn(msg) Feb 17 03:25:26.720422 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-1d80af2e-104f-4858-84f8-e53624000c19 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:25:26.720919 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-1d80af2e-104f-4858-84f8-e53624000c19 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:25:26.721785 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-1d80af2e-104f-4858-84f8-e53624000c19 admin admin] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:25:26.722264 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-1d80af2e-104f-4858-84f8-e53624000c19 admin admin] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:25:26.752405 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-1d80af2e-104f-4858-84f8-e53624000c19 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.089835 Feb 17 03:25:26.752984 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 34/68] 10.222.0.57 () {60 vars in 1184 bytes} [Wed Feb 17 03:25:26 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:25:28.316403 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-3c2fd109-e95e-4301-805c-bafef97b3d9c admin admin] Calling method '>' {{(pid=83239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:25:28.317510 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-3c2fd109-e95e-4301-805c-bafef97b3d9c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Feb 17 03:25:28.318199 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83239|app: 0|req: 35/69] 10.222.0.57 () {56 vars in 1065 bytes} [Wed Feb 17 03:25:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:25:28.500908 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG nova.api.openstack.wsgi [None req-cb198429-85ee-4d0a-ab81-e2bc4a1ca4e9 admin admin] Calling method '>' {{(pid=83240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:25:28.502183 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:25:28.502183 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: warnings.warn(msg) Feb 17 03:25:28.503769 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-cb198429-85ee-4d0a-ab81-e2bc4a1ca4e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:25:28.504302 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-cb198429-85ee-4d0a-ab81-e2bc4a1ca4e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:25:28.505171 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-cb198429-85ee-4d0a-ab81-e2bc4a1ca4e9 admin admin] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:25:28.505649 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: DEBUG oslo_concurrency.lockutils [None req-cb198429-85ee-4d0a-ab81-e2bc4a1ca4e9 admin admin] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83240) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:25:28.532897 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: INFO nova.api.openstack.requestlog [None req-cb198429-85ee-4d0a-ab81-e2bc4a1ca4e9 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.086804 Feb 17 03:25:28.533426 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: [pid: 83240|app: 0|req: 35/70] 10.222.0.57 () {60 vars in 1184 bytes} [Wed Feb 17 03:25:28 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:26:29.187960 dv-cinder-759943-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 17 03:26:29.188409 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: Wed Feb 17 03:26:29 2021 - graceful shutdown triggered... Feb 17 03:26:29.188829 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: Gracefully killing worker 1 (pid: 83239)... Feb 17 03:26:29.188921 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: Gracefully killing worker 2 (pid: 83240)... Feb 17 03:26:30.188847 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: worker 1 buried after 1 seconds Feb 17 03:26:30.188847 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: worker 2 buried after 1 seconds Feb 17 03:26:30.188847 dv-cinder-759943-5-iscsi devstack@n-api.service[83238]: goodbye to uWSGI. Feb 17 03:26:30.190485 dv-cinder-759943-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 17 03:26:30.192173 dv-cinder-759943-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 17 03:26:30.200268 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 17 03:26:30.202274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: *** Starting uWSGI 2.0.15-debian (64bit) on [Wed Feb 17 03:26:30 2021] *** Feb 17 03:26:30.202274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Feb 17 03:26:30.202274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Feb 17 03:26:30.202274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: nodename: dv-cinder-759943-5-iscsi Feb 17 03:26:30.202274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: machine: x86_64 Feb 17 03:26:30.202274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: clock source: unix Feb 17 03:26:30.202274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: pcre jit disabled Feb 17 03:26:30.202274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: detected number of CPU cores: 4 Feb 17 03:26:30.202274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: current working directory: / Feb 17 03:26:30.202274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: detected binary path: /usr/bin/uwsgi-core Feb 17 03:26:30.202274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: dropping root privileges as early as possible Feb 17 03:26:30.202274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: your processes number limit is 47843 Feb 17 03:26:30.203354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: your memory page size is 4096 bytes Feb 17 03:26:30.203354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: detected max file descriptor number: 2048 Feb 17 03:26:30.203354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: lock engine: pthread robust mutexes Feb 17 03:26:30.203354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: thunder lock: enabled Feb 17 03:26:30.203354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 17 03:26:30.203354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: dropping root privileges after socket binding Feb 17 03:26:30.203354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Feb 17 03:26:30.248563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Python main interpreter initialized at 0x55cd7b36f9c0 Feb 17 03:26:30.248563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: dropping root privileges after plugin initialization Feb 17 03:26:30.248563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: python threads support enabled Feb 17 03:26:30.248563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: your server socket listen backlog is limited to 100 connections Feb 17 03:26:30.248563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: your mercy for graceful operations on workers is 90 seconds Feb 17 03:26:30.249104 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: mapped 402621 bytes (393 KB) for 2 cores Feb 17 03:26:30.249104 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: *** Operational MODE: preforking *** Feb 17 03:26:30.249283 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: dropping root privileges after application loading Feb 17 03:26:30.249283 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: *** uWSGI is running in multiple interpreter mode *** Feb 17 03:26:30.249283 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: spawned uWSGI master process (pid: 98101) Feb 17 03:26:30.249419 dv-cinder-759943-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 17 03:26:30.265110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: spawned uWSGI worker 1 (pid: 98103, cores: 1) Feb 17 03:26:30.265110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: spawned uWSGI worker 2 (pid: 98104, cores: 1) Feb 17 03:26:30.265110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 17 03:26:34.800766 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 03:26:34.801356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 03:26:34.802662 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 03:26:34.803097 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 03:26:34.803393 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 03:26:34.803858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.804230 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.804598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.804965 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.805378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.805734 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.806098 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.806460 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.806837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.807135 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.807497 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.807871 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759943-5-iscsi {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.808242 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.809127 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.809483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.809850 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.810198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.810568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.810917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.811533 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.811886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.812234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.812454 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 17 03:26:34.812565 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.812767 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 17 03:26:34.812945 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.813333 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.813687 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.814058 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.814398 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 17 03:26:34.814500 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.814758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.814881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 17 03:26:34.815087 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 17 03:26:34.815198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.815454 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759943-5-iscsi {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.815568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.815818 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.815930 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.816174 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.816279 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.816534 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.816654 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.816944 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.817086 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.817336 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.817450 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.817705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.817903 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.818049 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.818464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.818768 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.818913 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.819039 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.819152 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.819948 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.820040 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.820121 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759943-5-iscsi {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.820200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.820289 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.820373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.820451 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.820534 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.820692 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.820788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.821059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.821159 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.821411 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.821498 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.821774 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.821872 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.822119 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.822216 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.822456 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.822735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.822836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.824150 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.825798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.825915 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.826027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.826027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.826241 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.826241 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.826444 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.826552 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.826665 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.826772 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.826894 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.827005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.827106 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.827214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.827324 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.827434 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.827540 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.827646 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.827771 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.827900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.828023 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759943-5-iscsi {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.828141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.828247 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.828352 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.828452 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.828559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.828672 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.828777 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.828777 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.828982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.829122 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.829237 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.829344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.829451 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.829559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.829668 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.829838 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.830184 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.830285 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.830364 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.830587 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.830689 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.830893 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.831014 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.831243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.831359 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.831638 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.831751 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.831980 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.832092 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.832327 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.832432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.832675 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.832779 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.833066 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.833175 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.833405 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.833517 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.833745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.833866 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.834039 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.834145 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.834397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.834502 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.834766 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.834921 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.835114 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.835231 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.835402 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.835514 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.835746 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.835890 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.836038 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.836148 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.836410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.836524 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.836751 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.836862 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.837150 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.837275 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.837476 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.837586 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.837816 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.837926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.838161 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.838275 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.838500 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.838613 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.838846 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.838957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.839187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.839310 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.839533 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.839655 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.839898 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.840019 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.840247 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.840343 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.840594 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.840764 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.840921 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.841091 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.841303 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.841418 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.841677 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.841795 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.842025 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.842135 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.842371 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.842482 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.842710 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.842824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.843055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.843166 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.843421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.843536 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.843770 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.843888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.844119 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.844224 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.844467 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.844577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.844805 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.844923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.845175 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.845295 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.845539 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.845643 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.845887 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.845999 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.846231 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.846336 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.846524 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.846643 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.846871 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.846977 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.847276 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.847440 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.847643 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.847773 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.847991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.848124 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.848329 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.848452 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.848673 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.848801 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.849013 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.849197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.849414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.849560 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.849803 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.849964 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.850116 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.850267 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.850415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.850558 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.850699 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.850854 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.851004 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.851153 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.851302 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.851453 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.851638 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.851774 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.851980 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.852136 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.852320 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.852451 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.852687 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.852847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.853055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.853217 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.853414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.853562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.853767 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.853927 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.854120 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.854273 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.854490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.854645 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.854839 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.854986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.855190 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.855343 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.855562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.855709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.855915 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.856062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.856266 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.856414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.856610 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.856755 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.856959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.857136 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.857330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.857461 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.857698 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.857828 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.858033 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.858192 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.858732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.858887 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.859110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.859266 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.859500 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.859664 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.859828 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.860066 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.860219 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.860371 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.860494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.860635 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.860783 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.860926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.861149 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.861288 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.861429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.861577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.861727 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.861878 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.862066 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.862222 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.862439 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.862586 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.862818 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.862966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.863172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.863331 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.863527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.863680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.863876 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.864023 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.864224 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.864377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 17 03:26:34.864583 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.864732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.864940 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.865172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.865330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.865473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.865615 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.865736 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.866000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.866162 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.866359 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.866505 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.866716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.866848 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.867063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.867220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.867409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.867532 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.867755 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.867900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.868105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.868261 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.868444 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.868590 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.868793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.868939 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.869192 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.869348 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.869615 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.869776 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.869927 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.870065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.870302 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.870423 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.870544 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.870703 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.870852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.870975 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.871720 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.871867 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.872082 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.872229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.872436 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.872571 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.872784 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.872936 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.873163 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.873316 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.873531 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.873690 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.873879 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.874025 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.874242 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.874390 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.874588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.874746 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.874936 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.875096 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.875291 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.875443 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.875642 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.875800 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.875992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.876139 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.876337 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.876491 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.876692 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.876851 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.877055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.877204 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.877414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.877568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.877794 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.877942 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.878158 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.878312 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.878497 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.878648 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.878842 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.878989 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.879191 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.879338 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.879542 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.879700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.880035 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.880182 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.880337 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.880566 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.880711 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.880853 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.881003 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.881181 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.881330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.881472 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.881620 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.881777 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.881924 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.882073 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.882215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.882356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.882504 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.882656 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.882804 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.882953 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.883095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.883243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.883446 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.883601 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.883799 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.883946 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.884148 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.884301 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.884494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.884750 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.884897 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.885139 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.885285 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.885438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.885582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.885735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.885880 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.886021 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.886226 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.886381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.886584 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.886776 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.886998 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.887154 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.887345 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.887492 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.887692 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.887847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.888040 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.888193 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.888391 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.888544 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.888755 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.888909 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.889126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.889280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.889480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.889634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.889828 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.890067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.890214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.890356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.890498 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.890652 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.890897 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.891051 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.891194 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.891335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.891484 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.891633 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.891822 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.891969 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.892171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.892317 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.892517 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.892674 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.892858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.893012 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.893192 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.893343 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.893546 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.893704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.893901 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.894054 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.894242 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.894388 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.894585 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.894740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.894937 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.895083 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.895281 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.895427 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.895633 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.895777 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.895921 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.896061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.896266 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.896413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.896609 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.896764 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.896963 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.897157 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.897357 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.897515 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.897703 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.897849 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.898065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.898218 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.898421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.898568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.898763 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.898909 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.899099 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.899251 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.899450 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.899597 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.899794 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.899940 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.900173 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.900325 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.900475 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.900629 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.900772 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.900925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.901183 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.901330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.901480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.901631 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.901780 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.901922 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.902146 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.902802 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.903032 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.903190 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.903385 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.903531 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.903734 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.903881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.904079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.904235 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.904428 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.904583 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.904779 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.904931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.905165 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.905322 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.905520 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.905672 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.905872 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.906025 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.906216 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.906370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.906564 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.906716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.906907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.907060 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.907261 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.907407 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.907602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.907754 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.907941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.908093 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.908285 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.908414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.908630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.908782 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.908982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.909150 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.909363 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.909520 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.909735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.910062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.910229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.910455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.910608 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.910751 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.910893 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.911087 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.911328 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.911488 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.911637 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.911786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.911943 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.912086 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.912235 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.912390 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.912561 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.912765 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.912918 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.913139 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.913286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.913485 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.913639 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.913824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.913977 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.914165 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.914318 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.914518 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.914675 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.914861 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.915007 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.915207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.915361 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.915554 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.915707 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.915896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.916042 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.916240 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.916394 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.916584 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.916730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.916928 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.917146 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.917291 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.917446 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.917642 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.917789 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.918057 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.918705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.918909 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.919065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.919254 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.919413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.919603 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.919749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.919949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.920104 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.920292 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.920462 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.920685 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.920838 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.920989 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.921155 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.921421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.921679 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.921835 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.922053 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.922207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.922415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.922567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.922781 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.922925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.923120 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.923278 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.923466 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.923612 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.923837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.923981 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.924183 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.924333 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.924526 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.924678 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.924868 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.925013 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.925252 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.925398 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.925598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.925744 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.925942 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.926070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.926291 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.926431 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.926635 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.926780 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.926977 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.927128 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.927317 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.927463 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.927661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.927784 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.928003 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.928156 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.928306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.928422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.928654 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.928780 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.928993 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.929241 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.929387 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.929537 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.929680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.929823 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.929971 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.930099 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.930335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.930482 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.930730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.930869 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.931012 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.931139 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.931330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.931460 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.931682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.931835 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.932051 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.932207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.932734 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.932836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.932944 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.933080 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.933184 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.933283 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.933382 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.933573 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.933731 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.933849 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.934045 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.934155 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.934390 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.934545 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.934735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.934848 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.935085 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.935190 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.935429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.935533 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.935771 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.935883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.936112 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.936217 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.936451 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.936561 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.936785 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.936890 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.937170 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.937283 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.937517 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.937624 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.937858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.937964 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.938193 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.938305 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.938530 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.938641 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.938892 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.939003 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.939229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.939382 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.939567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.939678 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.939914 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.940027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.940268 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.940373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.940620 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.940731 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.940970 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.941093 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.941343 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.941456 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.941702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.941865 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.942008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.942110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.942363 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.942474 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.942704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.942816 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.943041 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.943466 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.943647 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.943801 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.943991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.944107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.944346 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.944451 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.944684 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.944796 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.945055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.945179 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.945411 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.945523 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.945749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.945853 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.946089 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.946250 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.946435 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.946540 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.946774 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.946878 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.947118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.947225 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.947455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.947568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.947799 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.947905 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.948138 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.948250 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.948479 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.948583 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.948832 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.948980 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.949202 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.949308 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.949557 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.949660 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.949897 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.950001 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.950241 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.950346 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.950588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.950699 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.950960 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.951075 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.951311 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.951416 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.951656 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.951767 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.952008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.952120 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.952358 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.952469 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.952702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.952832 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.953061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.953180 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.953416 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.953563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.953776 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.953926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.954130 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.954249 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.954476 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.954587 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.954845 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.955014 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.955203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.955315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.955555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.955659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.955911 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.956016 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.956258 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.956362 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.956620 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.956725 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.956971 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.957103 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.957355 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.957469 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.957709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.957820 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.958046 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.958158 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.958394 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.958506 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.958737 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.958841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.959085 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.959189 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.959426 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.959531 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.959771 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.959882 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.960116 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.960229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.960464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.960568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.960801 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.960912 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.961172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.961348 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.961533 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.961644 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.961884 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.961990 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.962259 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.962373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.962613 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.962762 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.962963 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.963114 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.963317 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.963466 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.963668 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.963832 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.964028 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.964203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.964378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.964573 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.965415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.965529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.965780 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.965902 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.966130 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.966240 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.966485 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.966589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.966844 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.966949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.967187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.967299 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.967545 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.967656 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.967881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.967992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.968228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.968340 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.968590 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.968700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.968947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.969081 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.969341 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.969446 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.969725 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.969837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.970076 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.970192 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.970425 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.970535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.970782 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.970885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.971153 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.971312 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.971491 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.971596 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.971832 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.971943 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.972175 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.972286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.972523 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.972630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.972863 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.972993 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.973253 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.973368 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.973601 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.973706 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.973955 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.974085 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.974309 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.974421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.974661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.974833 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.975006 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.975191 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.975349 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.975548 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.975718 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.975917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.976066 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.976304 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.976496 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.976680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.976853 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.977070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.977249 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.977413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.977619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.977771 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.977967 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.978144 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.978335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.978517 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.978687 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.978874 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.979035 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.979234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.979380 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.979585 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.979696 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.979957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.980062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.980328 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.980480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.981305 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.981413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.981675 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.981786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.982045 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.982148 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.982399 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.982490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.982784 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.982888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.983154 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.983263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.983514 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.983618 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.983859 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.983969 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.984208 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.984324 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.984546 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.984652 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.984892 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.985003 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.985264 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.985378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.985605 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.985760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.985954 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.986060 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.986300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.986417 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.986649 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.986753 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.986984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.987088 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.987329 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.987446 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.987671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.987781 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.988029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.988132 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.988371 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.988483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.988731 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.988842 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.989102 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.989211 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.989448 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.989559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.989794 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.989899 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.990138 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.990243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.990500 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.990605 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.990844 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.990949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.991187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.991300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.991535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.991640 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.991881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.991992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.992246 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.992357 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.992598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.992706 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.992967 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.993106 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.993362 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.993475 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.993723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.993829 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.994071 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.994191 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.994422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.994530 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.994781 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.994893 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.995138 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.995294 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.995497 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.995602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.995842 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.995951 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.996224 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.996338 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.996571 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.996684 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.996923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.997059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.997296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.997552 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.997657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.997930 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.998041 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.998293 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.998407 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.998641 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.998752 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.998986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.999091 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.999325 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.999464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.999679 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:34.999785 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.000042 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.000155 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.000363 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.000544 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.000717 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.000830 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.001092 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.001203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.001440 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.001580 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.001780 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.001901 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.002157 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.002269 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.002500 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.002606 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.002885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.003039 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.003234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.003365 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.003591 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.003698 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.003946 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.004060 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.004300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.004438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.004676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.004772 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.005064 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.005190 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.005415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.005529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.005768 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.005879 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.006120 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.006233 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.006473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.006588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.006824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.006979 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.007178 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.007291 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.007525 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.007639 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.007876 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.008012 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.008225 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.008338 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.008576 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.008686 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.008928 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.009203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.009320 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.009588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.009711 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.009973 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.010085 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.010333 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.010438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.010679 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.010791 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.011029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.011135 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.011375 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.011485 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.011752 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.011998 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.012114 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.012357 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.012527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.012747 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.012865 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.013116 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.013234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.013482 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.013587 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.013843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.013957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.014204 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.014309 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.014559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.014670 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.014907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.015018 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.015252 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.015363 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.015603 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.015714 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.015944 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.016056 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.016290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.016400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.016641 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.016752 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.016993 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.017149 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.017364 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.017470 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.017721 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.017839 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.018062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.018167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.018426 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.018683 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.018795 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.019092 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.019204 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.019456 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.019561 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.019820 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.019931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.020176 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.020288 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.020530 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.020640 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.020881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.020992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.021276 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.021383 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.021628 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.021733 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.021979 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.022095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.022329 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.022434 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.022675 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.022813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.023027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.023141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.023364 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.023632 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.023738 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.023994 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.024105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.024355 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.024477 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.024706 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.024811 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.025063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.025185 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.025445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.025550 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.025792 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.025903 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.026138 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.026257 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.026481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.026599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.026827 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.026932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.027172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.027790 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.028027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.028131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.028371 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.028483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.028705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.028818 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.029123 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.029242 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.029430 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.029534 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.029779 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.029892 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.030124 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.030237 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.030477 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.030740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.030858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.031143 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.031255 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.031488 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.031594 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.031857 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.032005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.032202 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.032308 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.032545 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.032651 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.032893 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.033006 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.033269 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.033401 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.033629 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.033766 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.033974 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.034087 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.034327 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.034432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.034681 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.034786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.035034 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.035177 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.035387 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.035636 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.035747 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.036017 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.036155 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.036383 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.036494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.036730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.036847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.037100 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.037255 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.037482 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.037583 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.037825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.037930 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.038165 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.038282 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.038516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.038632 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.038862 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.038967 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.039203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.039323 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.039547 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.039661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.039889 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.039995 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.040232 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.040344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.040582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.040687 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.040924 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.041050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.041307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.041420 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.041659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.041765 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.042008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.042113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.042359 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.042471 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.042714 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.042819 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.043610 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.043723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.043972 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.044081 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.044327 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.044433 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.044674 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.044847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.045053 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.045173 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.045400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.045512 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.045751 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.045864 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.046102 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.046209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.046459 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.046563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.046804 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.046918 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.047150 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.047263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.047626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.047782 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.047980 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.048167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.048339 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.048536 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.048701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.048930 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.049098 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.049355 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.049468 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.049709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.049826 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.050060 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.050167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.050409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.050522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.050778 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.050895 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.051117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.051229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.051463 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.051570 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.051812 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.051929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.052167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.052272 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.052522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.052630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.052877 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.052984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.053263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.053369 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.053613 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.053753 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.053971 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.054127 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.054316 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.054422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.054668 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.054773 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.055024 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.055128 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.055377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.055529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.055732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.055850 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.056084 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.056196 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.056432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.056538 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.056776 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.056890 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.057151 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.057271 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.057498 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.057603 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.057852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.057969 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.058190 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.058295 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.058567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.058720 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.058922 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.059036 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.059273 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.059379 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.059654 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.059771 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.060011 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.060124 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.060379 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.060491 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.060732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.060838 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.061122 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.061230 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.061477 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.061583 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.061848 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.061960 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.062217 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.062327 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.062562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.062673 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.062906 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.063018 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.063249 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.063359 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.063604 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.063714 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.063952 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.064057 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.064360 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.064549 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.064729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.064904 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.065124 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.065301 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.065510 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.065646 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.065872 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.065976 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.066228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.066353 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.066586 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.066700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.066942 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.067055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.067299 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.067416 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.067657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.067762 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.068010 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.068378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.068628 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.068734 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.068980 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.069140 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.069359 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.069465 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.069712 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.069824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.070055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.070160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.070404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.070509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.070756 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.070860 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.071103 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.071215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.071465 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.071569 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.071834 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.071946 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.072187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.072292 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.072551 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.072655 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.072901 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.073012 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.073293 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.073398 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.073642 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.073763 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.074016 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.074151 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.074314 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98104) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 03:26:35.074407 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.074757 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.075115 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.075498 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.075855 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.076216 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.076815 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.077201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.077563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.077923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.078303 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.078684 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.079036 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.079413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.079780 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.080146 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.080507 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.080867 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.081278 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.081638 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.082000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.082358 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.082716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.083079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.083444 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.083822 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.084198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.084573 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.084953 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.085378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.085740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.086133 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.086513 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 17 03:26:35.086797 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98103) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 17 03:26:35.110083 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_db.sqlalchemy.engines [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98104) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:26:35.123098 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_db.sqlalchemy.engines [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98103) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:26:35.373610 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.context [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb2942c0-ebf7-43c0-b475-e153b195efa7(cell1) {{(pid=98104) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 03:26:35.379188 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:35.381071 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:35.383857 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:35.384066 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:35.388220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.context [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb2942c0-ebf7-43c0-b475-e153b195efa7(cell1) {{(pid=98103) load_cells /opt/stack/nova/nova/context.py:466}} Feb 17 03:26:35.393882 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:35.395749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:35.396657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:26:35.398831 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:26:35.409145 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_db.sqlalchemy.engines [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98104) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:26:35.424128 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_db.sqlalchemy.engines [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98104) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:26:35.426355 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_db.sqlalchemy.engines [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98103) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:26:35.434240 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_db.sqlalchemy.engines [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98103) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:26:35.453388 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_db.sqlalchemy.engines [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98104) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:26:35.461639 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_db.sqlalchemy.engines [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98103) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 17 03:26:35.537370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 03:26:35.537370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: from cryptography.utils import int_from_bytes Feb 17 03:26:35.537841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 03:26:35.537841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: from cryptography.utils import int_from_bytes Feb 17 03:26:35.548355 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 03:26:35.548355 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: from cryptography.utils import int_from_bytes Feb 17 03:26:35.548746 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 17 03:26:35.548746 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: from cryptography.utils import int_from_bytes Feb 17 03:26:35.615055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO keyring.backend [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] Loading Gnome Feb 17 03:26:35.626926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO keyring.backend [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] Loading Gnome Feb 17 03:26:35.636098 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO keyring.backend [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] Loading Google Feb 17 03:26:35.640172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO keyring.backend [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] Loading Windows (alt) Feb 17 03:26:35.644866 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO keyring.backend [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] Loading file Feb 17 03:26:35.646014 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO keyring.backend [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] Loading keyczar Feb 17 03:26:35.646446 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO keyring.backend [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] Loading multi Feb 17 03:26:35.647434 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO keyring.backend [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] Loading pyfs Feb 17 03:26:35.647976 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO keyring.backend [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] Loading Google Feb 17 03:26:35.651478 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO keyring.backend [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] Loading Windows (alt) Feb 17 03:26:35.656251 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO keyring.backend [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] Loading file Feb 17 03:26:35.657403 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO keyring.backend [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] Loading keyczar Feb 17 03:26:35.657867 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO keyring.backend [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] Loading multi Feb 17 03:26:35.658870 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO keyring.backend [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] Loading pyfs Feb 17 03:26:36.038985 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: WARNING keystonemiddleware.auth_token [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 03:26:36.046418 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: WARNING keystonemiddleware.auth_token [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 03:26:36.046847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: WARNING keystonemiddleware.auth_token [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 03:26:36.053735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: WARNING keystonemiddleware.auth_token [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 03:26:36.284848 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: WARNING keystonemiddleware.auth_token [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 03:26:36.288984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: WARNING keystonemiddleware.auth_token [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 17 03:26:36.290571 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: WARNING keystonemiddleware.auth_token [None req-df89a177-53a2-4a42-976b-f028302d7dbe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 03:26:36.295379 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: WARNING keystonemiddleware.auth_token [None req-c3d68f0b-c4f0-467b-893b-393598e79846 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 17 03:26:36.296751 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cd7b36f9c0 pid: 98104 (default app) Feb 17 03:26:36.300946 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cd7b36f9c0 pid: 98103 (default app) Feb 17 03:27:15.641890 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bd22552a-ced8-449d-b076-32e44649ccee tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Action: 'create', calling method: .version_select at 0x7f98b101e2f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-740130369"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:17.054287 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bd22552a-ced8-449d-b076-32e44649ccee tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.361710 Feb 17 03:27:17.054953 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1145 bytes} [Wed Feb 17 03:27:14 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 2364 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Feb 17 03:27:17.372251 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4b47d8c0-5117-42ab-b417-49a7a360e5a4 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Calling method '.version_select at 0x7f98b1157e18>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:17.821928 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4b47d8c0-5117-42ab-b417-49a7a360e5a4 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/36d8ba01-a1bd-4ca2-8b55-bff12806180a" status: 200 len: 344 microversion: 2.1 time: 0.756897 Feb 17 03:27:17.826329 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 1/2] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Feb 17 03:27:17 2021] GET /compute/v2.1/os-volumes/36d8ba01-a1bd-4ca2-8b55-bff12806180a => generated 344 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:18.117803 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0efb2a70-1480-46a6-8776-dcf68024c9bb tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1465111309", "imageRef": "27891a64-31b3-4754-87b4-bf609a12c59a", "flavorRef": "452", "networks": [{"uuid": "7250ffa3-b5f2-45bc-8c2b-8a04a901bc68"}]}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:18.265185 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-0efb2a70-1480-46a6-8776-dcf68024c9bb tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] validate_networks() for [('7250ffa3-b5f2-45bc-8c2b-8a04a901bc68', None, None, None)] {{(pid=98104) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:27:18.840876 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-eebdcb94-f8a4-45dc-aa0c-1df6c900defa tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Calling method '.version_select at 0x7f98b0f21378>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:19.087843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-eebdcb94-f8a4-45dc-aa0c-1df6c900defa tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/36d8ba01-a1bd-4ca2-8b55-bff12806180a" status: 200 len: 345 microversion: 2.1 time: 0.251725 Feb 17 03:27:19.090667 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Feb 17 03:27:18 2021] GET /compute/v2.1/os-volumes/36d8ba01-a1bd-4ca2-8b55-bff12806180a => generated 345 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:19.104000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-accede08-a5be-49ad-9059-5b129ef21e97 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Action: 'create', calling method: .version_select at 0x7f98b0f21400>, body: {"snapshot": {"volume_id": "36d8ba01-a1bd-4ca2-8b55-bff12806180a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-916672437"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:19.649307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-accede08-a5be-49ad-9059-5b129ef21e97 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.550620 Feb 17 03:27:19.650831 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 3/4] 10.222.0.57 () {60 vars in 1152 bytes} [Wed Feb 17 03:27:19 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:27:19.665170 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-20122575-ee82-43ca-ba7f-660e21bf5b7d tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Calling method '.version_select at 0x7f98b1031f28>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:19.767857 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-20122575-ee82-43ca-ba7f-660e21bf5b7d tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577" status: 200 len: 286 microversion: 2.1 time: 0.109114 Feb 17 03:27:19.768934 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 4/5] 10.222.0.57 () {58 vars in 1241 bytes} [Wed Feb 17 03:27:19 2021] GET /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577 => generated 286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:19.778635 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-20e2be4b-d65f-49d9-92bf-fc5f2ae0d046 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Calling method '.version_select at 0x7f98b0ef1488>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:19.829231 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-20e2be4b-d65f-49d9-92bf-fc5f2ae0d046 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.054117 Feb 17 03:27:19.830080 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 5/6] 10.222.0.57 () {58 vars in 1130 bytes} [Wed Feb 17 03:27:19 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:27:19.841421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7564ef99-3088-42a2-b7cf-65a1eff671c2 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Calling method '.version_select at 0x7f98b1031e18>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:19.905318 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7564ef99-3088-42a2-b7cf-65a1eff671c2 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577" status: 200 len: 286 microversion: 2.1 time: 0.068006 Feb 17 03:27:19.906129 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 6/7] 10.222.0.57 () {58 vars in 1241 bytes} [Wed Feb 17 03:27:19 2021] GET /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:27:20.650989 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-0efb2a70-1480-46a6-8776-dcf68024c9bb tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Flavor limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:27:20.653052 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-0efb2a70-1480-46a6-8776-dcf68024c9bb tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Image limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:27:20.653810 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-0efb2a70-1480-46a6-8776-dcf68024c9bb tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Flavor pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:27:20.654630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-0efb2a70-1480-46a6-8776-dcf68024c9bb tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Image pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:27:20.655565 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-0efb2a70-1480-46a6-8776-dcf68024c9bb tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:27:20.676677 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0efb2a70-1480-46a6-8776-dcf68024c9bb tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:20.677622 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0efb2a70-1480-46a6-8776-dcf68024c9bb tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:20.679982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0efb2a70-1480-46a6-8776-dcf68024c9bb tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:20.681717 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0efb2a70-1480-46a6-8776-dcf68024c9bb tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:20.728518 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-0efb2a70-1480-46a6-8776-dcf68024c9bb tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Getting quotas for project f26d86e30e4e473798e908122de8a6fc. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:27:20.737763 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-0efb2a70-1480-46a6-8776-dcf68024c9bb tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Getting quotas for user 04bc2f7bc7dc45f9a4b4c31ccc52599d and project f26d86e30e4e473798e908122de8a6fc. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:27:20.754421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0efb2a70-1480-46a6-8776-dcf68024c9bb tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Going to run 1 instances... {{(pid=98104) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:27:20.764632 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0efb2a70-1480-46a6-8776-dcf68024c9bb tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27891a64-31b3-4754-87b4-bf609a12c59a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:27:20.918050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-24c3904d-ad00-4ef2-a22e-b7e7ebf72d71 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Calling method '.version_select at 0x7f98b1031a60>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:20.953193 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0efb2a70-1480-46a6-8776-dcf68024c9bb tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.896851 Feb 17 03:27:20.953933 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 2/8] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:27:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 2899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 17 03:27:20.966812 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1dbee879-03f4-4327-a958-924c1dc204c8 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:20.967495 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1dbee879-03f4-4327-a958-924c1dc204c8 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:20.982991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-24c3904d-ad00-4ef2-a22e-b7e7ebf72d71 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577" status: 200 len: 286 microversion: 2.1 time: 0.068752 Feb 17 03:27:20.984241 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 7/9] 10.222.0.57 () {58 vars in 1241 bytes} [Wed Feb 17 03:27:20 2021] GET /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:21.127920 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1dbee879-03f4-4327-a958-924c1dc204c8 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:21.148870 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1dbee879-03f4-4327-a958-924c1dc204c8 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1215 microversion: 2.1 time: 0.186829 Feb 17 03:27:21.160089 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 3/10] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:20 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1215 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:27:21.749650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4f13ff0c-dd3d-4d6e-a947-b50148e4ca77 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-130031874", "imageRef": "27891a64-31b3-4754-87b4-bf609a12c59a", "flavorRef": "452", "networks": [{"uuid": "90e5bf38-a0dc-48bd-9401-739bcf8a5d8a"}]}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:21.985372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-4f13ff0c-dd3d-4d6e-a947-b50148e4ca77 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] validate_networks() for [('90e5bf38-a0dc-48bd-9401-739bcf8a5d8a', None, None, None)] {{(pid=98103) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:27:21.996298 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-84ff6853-3eb9-4636-88eb-018d0bd834c1 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Calling method '.version_select at 0x7f98b0e6d510>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:22.089511 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-84ff6853-3eb9-4636-88eb-018d0bd834c1 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577" status: 200 len: 286 microversion: 2.1 time: 0.097909 Feb 17 03:27:22.090235 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 4/11] 10.222.0.57 () {58 vars in 1241 bytes} [Wed Feb 17 03:27:21 2021] GET /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577 => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:22.168171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9f48ff69-9af4-4971-a6d4-196bdc372104 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:22.169256 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9f48ff69-9af4-4971-a6d4-196bdc372104 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:22.372791 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9f48ff69-9af4-4971-a6d4-196bdc372104 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:22.387995 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9f48ff69-9af4-4971-a6d4-196bdc372104 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1215 microversion: 2.1 time: 0.222015 Feb 17 03:27:22.388788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 5/12] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:22 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1215 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:27:23.102259 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-55131e8e-c1fb-4bbf-a2d9-022e74ff0881 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Calling method '.version_select at 0x7f98b0e8ce18>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:23.189647 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-55131e8e-c1fb-4bbf-a2d9-022e74ff0881 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577" status: 200 len: 286 microversion: 2.1 time: 0.091216 Feb 17 03:27:23.190720 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 6/13] 10.222.0.57 () {58 vars in 1241 bytes} [Wed Feb 17 03:27:23 2021] GET /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577 => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:23.406396 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c440c571-319f-4d26-aab5-4027f47c0e5d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:23.407353 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c440c571-319f-4d26-aab5-4027f47c0e5d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:23.426598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c440c571-319f-4d26-aab5-4027f47c0e5d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:23.427229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c440c571-319f-4d26-aab5-4027f47c0e5d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:23.428269 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c440c571-319f-4d26-aab5-4027f47c0e5d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:23.432146 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c440c571-319f-4d26-aab5-4027f47c0e5d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:24.175015 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-4f13ff0c-dd3d-4d6e-a947-b50148e4ca77 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:27:24.175489 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-4f13ff0c-dd3d-4d6e-a947-b50148e4ca77 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:27:24.175999 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-4f13ff0c-dd3d-4d6e-a947-b50148e4ca77 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:27:24.176454 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-4f13ff0c-dd3d-4d6e-a947-b50148e4ca77 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:27:24.176911 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-4f13ff0c-dd3d-4d6e-a947-b50148e4ca77 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:27:24.200208 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4f13ff0c-dd3d-4d6e-a947-b50148e4ca77 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:24.204040 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4f13ff0c-dd3d-4d6e-a947-b50148e4ca77 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:24.207114 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4f13ff0c-dd3d-4d6e-a947-b50148e4ca77 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:24.207937 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4f13ff0c-dd3d-4d6e-a947-b50148e4ca77 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:24.272068 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-4f13ff0c-dd3d-4d6e-a947-b50148e4ca77 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Getting quotas for project 41ae341c7001465897265b1c5eda9767. Resources: {'ram', 'cores', 'instances'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:27:24.286517 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-4f13ff0c-dd3d-4d6e-a947-b50148e4ca77 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Getting quotas for user 4d9f8d95ac0a4a4bb6aad0bbc963d08d and project 41ae341c7001465897265b1c5eda9767. Resources: {'ram', 'cores', 'instances'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:27:24.321191 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4f13ff0c-dd3d-4d6e-a947-b50148e4ca77 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Going to run 1 instances... {{(pid=98103) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:27:24.324865 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4f13ff0c-dd3d-4d6e-a947-b50148e4ca77 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27891a64-31b3-4754-87b4-bf609a12c59a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:27:24.492450 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4f13ff0c-dd3d-4d6e-a947-b50148e4ca77 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.023068 Feb 17 03:27:24.493185 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 8/14] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:27:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 3025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:27:24.499445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-aa3349d4-58bd-4443-b33d-ce77c6227ff7 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Calling method '.version_select at 0x7f98b0e76268>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:24.602117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-aa3349d4-58bd-4443-b33d-ce77c6227ff7 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577" status: 200 len: 286 microversion: 2.1 time: 0.107646 Feb 17 03:27:24.602939 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 9/15] 10.222.0.57 () {58 vars in 1241 bytes} [Wed Feb 17 03:27:24 2021] GET /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577 => generated 286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:24.618944 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c440c571-319f-4d26-aab5-4027f47c0e5d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:24.619100 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e272050b-c506-4582-98c0-7bb2fbd84563 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:24.619777 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e272050b-c506-4582-98c0-7bb2fbd84563 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:24.636473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c440c571-319f-4d26-aab5-4027f47c0e5d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1219 microversion: 2.1 time: 1.234255 Feb 17 03:27:24.637459 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 7/16] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:23 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1219 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:25.346350 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e272050b-c506-4582-98c0-7bb2fbd84563 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:25.372702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e272050b-c506-4582-98c0-7bb2fbd84563 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1217 microversion: 2.1 time: 0.766859 Feb 17 03:27:25.377469 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 10/17] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:24 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1217 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:25.615922 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c4df8684-7adb-4f4c-95d3-435e1eb6b67c tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Calling method '.version_select at 0x7f98b05a8bf8>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:25.658060 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f899516a-7b67-4212-8371-b7e3c471570d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:25.658722 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f899516a-7b67-4212-8371-b7e3c471570d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:25.670302 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f899516a-7b67-4212-8371-b7e3c471570d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:25.683236 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f899516a-7b67-4212-8371-b7e3c471570d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:25.684318 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f899516a-7b67-4212-8371-b7e3c471570d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:25.685154 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f899516a-7b67-4212-8371-b7e3c471570d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:25.738181 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c4df8684-7adb-4f4c-95d3-435e1eb6b67c tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577" status: 200 len: 287 microversion: 2.1 time: 0.126710 Feb 17 03:27:25.738967 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 8/18] 10.222.0.57 () {58 vars in 1241 bytes} [Wed Feb 17 03:27:25 2021] GET /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577 => generated 287 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:25.754285 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ea684bc9-b12b-4768-a0e2-f4e462f3bfde tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Calling method '.version_select at 0x7f98b05a80d0>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:26.082603 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ea684bc9-b12b-4768-a0e2-f4e462f3bfde tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577" status: 202 len: 0 microversion: 2.1 time: 0.335631 Feb 17 03:27:26.083208 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 9/19] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Feb 17 03:27:25 2021] DELETE /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:27:26.091987 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ec610864-3498-43d3-9a37-94d690275d84 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Calling method '.version_select at 0x7f98b4544e18>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:26.219496 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ec610864-3498-43d3-9a37-94d690275d84 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577" status: 200 len: 286 microversion: 2.1 time: 0.131735 Feb 17 03:27:26.220137 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 10/20] 10.222.0.57 () {58 vars in 1241 bytes} [Wed Feb 17 03:27:26 2021] GET /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:27:26.391437 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-682c9891-25e3-4f20-8889-23130027adda tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:26.392669 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-682c9891-25e3-4f20-8889-23130027adda tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:26.406930 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-682c9891-25e3-4f20-8889-23130027adda tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:26.410995 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-682c9891-25e3-4f20-8889-23130027adda tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:26.412403 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-682c9891-25e3-4f20-8889-23130027adda tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:26.416397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-682c9891-25e3-4f20-8889-23130027adda tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:26.993839 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f899516a-7b67-4212-8371-b7e3c471570d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:27.016085 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f899516a-7b67-4212-8371-b7e3c471570d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1267 microversion: 2.1 time: 1.361183 Feb 17 03:27:27.020578 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 11/21] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:25 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1267 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:27.232602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bb2332e7-b0e2-4f03-b77b-32f4e6ee9965 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Calling method '.version_select at 0x7f98b05b9ea0>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:27.322918 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-bb2332e7-b0e2-4f03-b77b-32f4e6ee9965 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] HTTP exception thrown: Snapshot c85d7d0c-0f63-424f-aec0-13c599a22577 could not be found. Feb 17 03:27:27.324179 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bb2332e7-b0e2-4f03-b77b-32f4e6ee9965 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Returning 404 to user: Snapshot c85d7d0c-0f63-424f-aec0-13c599a22577 could not be found. {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:27:27.329723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bb2332e7-b0e2-4f03-b77b-32f4e6ee9965 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577" status: 404 len: 111 microversion: 2.1 time: 0.101550 Feb 17 03:27:27.330459 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 12/22] 10.222.0.57 () {58 vars in 1241 bytes} [Wed Feb 17 03:27:27 2021] GET /compute/v2.1/os-snapshots/c85d7d0c-0f63-424f-aec0-13c599a22577 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:27:27.347682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-898eea80-3145-43bb-a1e0-cb4c480bebca tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Calling method '.version_select at 0x7f98b0e76598>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:27.553671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-682c9891-25e3-4f20-8889-23130027adda tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:27.565426 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-898eea80-3145-43bb-a1e0-cb4c480bebca tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/36d8ba01-a1bd-4ca2-8b55-bff12806180a" status: 202 len: 0 microversion: 2.1 time: 0.229426 Feb 17 03:27:27.567179 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 13/23] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Feb 17 03:27:27 2021] DELETE /compute/v2.1/os-volumes/36d8ba01-a1bd-4ca2-8b55-bff12806180a => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:27:27.576767 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e68d9205-9a17-4222-9606-f1948a072c12 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Calling method '.version_select at 0x7f98b0e92158>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:27.582074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-682c9891-25e3-4f20-8889-23130027adda tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1213 microversion: 2.1 time: 1.194585 Feb 17 03:27:27.582675 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 11/24] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:26 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1213 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:27:27.796620 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e68d9205-9a17-4222-9606-f1948a072c12 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/36d8ba01-a1bd-4ca2-8b55-bff12806180a" status: 200 len: 344 microversion: 2.1 time: 0.224698 Feb 17 03:27:27.797564 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 14/25] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Feb 17 03:27:27 2021] GET /compute/v2.1/os-volumes/36d8ba01-a1bd-4ca2-8b55-bff12806180a => generated 344 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:28.037532 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-029cc6bb-bc1c-48ef-b22f-5fe36d523a5e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:28.037532 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-029cc6bb-bc1c-48ef-b22f-5fe36d523a5e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:28.054772 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-029cc6bb-bc1c-48ef-b22f-5fe36d523a5e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:28.055285 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-029cc6bb-bc1c-48ef-b22f-5fe36d523a5e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:28.056127 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-029cc6bb-bc1c-48ef-b22f-5fe36d523a5e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:28.056641 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-029cc6bb-bc1c-48ef-b22f-5fe36d523a5e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:28.440235 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-029cc6bb-bc1c-48ef-b22f-5fe36d523a5e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:28.459729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-029cc6bb-bc1c-48ef-b22f-5fe36d523a5e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1273 microversion: 2.1 time: 0.426929 Feb 17 03:27:28.460354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 12/26] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:28 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1273 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:28.601649 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5a2df519-c8b7-47a7-a96e-f560e8c6e813 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:28.602941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5a2df519-c8b7-47a7-a96e-f560e8c6e813 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:28.653325 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a2df519-c8b7-47a7-a96e-f560e8c6e813 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:28.654133 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a2df519-c8b7-47a7-a96e-f560e8c6e813 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:28.655204 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a2df519-c8b7-47a7-a96e-f560e8c6e813 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:28.665847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a2df519-c8b7-47a7-a96e-f560e8c6e813 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:28.813699 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-24a3d8ad-6b37-4ae0-9ca7-bb9acc3d7c14 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Calling method '.version_select at 0x7f98b05bd268>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:28.959496 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-24a3d8ad-6b37-4ae0-9ca7-bb9acc3d7c14 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] HTTP exception thrown: Volume 36d8ba01-a1bd-4ca2-8b55-bff12806180a could not be found. Feb 17 03:27:28.960191 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-24a3d8ad-6b37-4ae0-9ca7-bb9acc3d7c14 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Returning 404 to user: Volume 36d8ba01-a1bd-4ca2-8b55-bff12806180a could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:27:28.961125 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-24a3d8ad-6b37-4ae0-9ca7-bb9acc3d7c14 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/36d8ba01-a1bd-4ca2-8b55-bff12806180a" status: 404 len: 109 microversion: 2.1 time: 0.154430 Feb 17 03:27:28.961759 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 13/27] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Feb 17 03:27:28 2021] GET /compute/v2.1/os-volumes/36d8ba01-a1bd-4ca2-8b55-bff12806180a => generated 109 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 03:27:28.974980 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5bd7315b-4837-4386-875a-ba1693a2930e tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Calling method '.version_select at 0x7f98b05bd400>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:29.155861 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-5bd7315b-4837-4386-875a-ba1693a2930e tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] HTTP exception thrown: Volume 36d8ba01-a1bd-4ca2-8b55-bff12806180a could not be found. Feb 17 03:27:29.156893 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5bd7315b-4837-4386-875a-ba1693a2930e tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Returning 404 to user: Volume 36d8ba01-a1bd-4ca2-8b55-bff12806180a could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:27:29.158084 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5bd7315b-4837-4386-875a-ba1693a2930e tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/36d8ba01-a1bd-4ca2-8b55-bff12806180a" status: 404 len: 109 microversion: 2.1 time: 0.187105 Feb 17 03:27:29.159149 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 14/28] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Feb 17 03:27:28 2021] DELETE /compute/v2.1/os-volumes/36d8ba01-a1bd-4ca2-8b55-bff12806180a => generated 109 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 03:27:29.167442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-70ff8807-94db-404c-8fb0-552750d11766 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Calling method '.version_select at 0x7f98b05c89d8>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:29.323711 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-70ff8807-94db-404c-8fb0-552750d11766 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] HTTP exception thrown: Volume 36d8ba01-a1bd-4ca2-8b55-bff12806180a could not be found. Feb 17 03:27:29.324740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-70ff8807-94db-404c-8fb0-552750d11766 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] Returning 404 to user: Volume 36d8ba01-a1bd-4ca2-8b55-bff12806180a could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:27:29.325885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-70ff8807-94db-404c-8fb0-552750d11766 tempest-VolumesSnapshotsTestJSON-435213080 tempest-VolumesSnapshotsTestJSON-435213080-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/36d8ba01-a1bd-4ca2-8b55-bff12806180a" status: 404 len: 109 microversion: 2.1 time: 0.162576 Feb 17 03:27:29.327018 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 15/29] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Feb 17 03:27:29 2021] GET /compute/v2.1/os-volumes/36d8ba01-a1bd-4ca2-8b55-bff12806180a => generated 109 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:27:29.483239 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ca284aa9-9814-4cbf-ac41-5dd35ad717ea tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:29.484824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ca284aa9-9814-4cbf-ac41-5dd35ad717ea tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:29.499506 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca284aa9-9814-4cbf-ac41-5dd35ad717ea tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:29.507716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca284aa9-9814-4cbf-ac41-5dd35ad717ea tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:29.509315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca284aa9-9814-4cbf-ac41-5dd35ad717ea tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:29.513243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca284aa9-9814-4cbf-ac41-5dd35ad717ea tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:30.093650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ca284aa9-9814-4cbf-ac41-5dd35ad717ea tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:30.106539 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ca284aa9-9814-4cbf-ac41-5dd35ad717ea tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1273 microversion: 2.1 time: 0.627861 Feb 17 03:27:30.115816 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 16/30] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:29 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1273 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:30.802949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5a2df519-c8b7-47a7-a96e-f560e8c6e813 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:30.818237 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5a2df519-c8b7-47a7-a96e-f560e8c6e813 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1275 microversion: 2.1 time: 2.219588 Feb 17 03:27:30.833001 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 15/31] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:28 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1275 bytes in 2237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:31.134601 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c31ffb2d-01b9-4395-9046-3f660f39c1c6 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:31.136434 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c31ffb2d-01b9-4395-9046-3f660f39c1c6 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:31.152816 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c31ffb2d-01b9-4395-9046-3f660f39c1c6 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:31.159792 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c31ffb2d-01b9-4395-9046-3f660f39c1c6 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:31.160929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c31ffb2d-01b9-4395-9046-3f660f39c1c6 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:31.161594 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c31ffb2d-01b9-4395-9046-3f660f39c1c6 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:31.859046 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c2554a60-de71-4097-832d-6520b14ad935 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:31.859871 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c2554a60-de71-4097-832d-6520b14ad935 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:31.883265 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c2554a60-de71-4097-832d-6520b14ad935 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:31.883763 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c2554a60-de71-4097-832d-6520b14ad935 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:31.892838 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c2554a60-de71-4097-832d-6520b14ad935 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:31.894521 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c2554a60-de71-4097-832d-6520b14ad935 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:32.014275 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c31ffb2d-01b9-4395-9046-3f660f39c1c6 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:32.028260 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c31ffb2d-01b9-4395-9046-3f660f39c1c6 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1273 microversion: 2.1 time: 0.898130 Feb 17 03:27:32.048083 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 17/32] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:31 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1273 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:32.323571 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c2554a60-de71-4097-832d-6520b14ad935 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:32.355076 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c2554a60-de71-4097-832d-6520b14ad935 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1275 microversion: 2.1 time: 0.507581 Feb 17 03:27:32.355676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 16/33] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:31 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1275 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:33.053770 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1176448d-cc1b-4cf0-865b-b3aacccb7401 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:33.054431 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1176448d-cc1b-4cf0-865b-b3aacccb7401 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:33.070886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1176448d-cc1b-4cf0-865b-b3aacccb7401 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:33.073054 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1176448d-cc1b-4cf0-865b-b3aacccb7401 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:33.074107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1176448d-cc1b-4cf0-865b-b3aacccb7401 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:33.077738 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1176448d-cc1b-4cf0-865b-b3aacccb7401 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:33.371909 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1176448d-cc1b-4cf0-865b-b3aacccb7401 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:33.374854 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-954a3b3d-455d-46e6-a772-5dcd862138ac tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:33.375841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-954a3b3d-455d-46e6-a772-5dcd862138ac tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:33.382601 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1176448d-cc1b-4cf0-865b-b3aacccb7401 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1273 microversion: 2.1 time: 0.334588 Feb 17 03:27:33.387474 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 18/34] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:33 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1273 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:33.396939 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-954a3b3d-455d-46e6-a772-5dcd862138ac tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:33.396939 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-954a3b3d-455d-46e6-a772-5dcd862138ac tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:33.396939 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-954a3b3d-455d-46e6-a772-5dcd862138ac tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:33.396939 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-954a3b3d-455d-46e6-a772-5dcd862138ac tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:34.407825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-90d8d504-0119-44fb-8816-ba4b850182f7 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:34.409264 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-90d8d504-0119-44fb-8816-ba4b850182f7 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:34.424309 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90d8d504-0119-44fb-8816-ba4b850182f7 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:34.429155 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90d8d504-0119-44fb-8816-ba4b850182f7 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:34.430208 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90d8d504-0119-44fb-8816-ba4b850182f7 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:34.430845 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90d8d504-0119-44fb-8816-ba4b850182f7 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:34.739667 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-90d8d504-0119-44fb-8816-ba4b850182f7 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:34.755065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-90d8d504-0119-44fb-8816-ba4b850182f7 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1273 microversion: 2.1 time: 0.354495 Feb 17 03:27:34.765664 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 19/35] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:34 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1273 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:35.890527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-954a3b3d-455d-46e6-a772-5dcd862138ac tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:35.900758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-954a3b3d-455d-46e6-a772-5dcd862138ac tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1317 microversion: 2.1 time: 2.531912 Feb 17 03:27:35.913810 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 17/36] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:33 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1317 bytes in 2546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:35.919551 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-21159d42-dc45-4330-8659-2bd9ec0db47f tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:35.929730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-21159d42-dc45-4330-8659-2bd9ec0db47f tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:35.952814 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-21159d42-dc45-4330-8659-2bd9ec0db47f tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:35.965852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-21159d42-dc45-4330-8659-2bd9ec0db47f tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:35.967079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-21159d42-dc45-4330-8659-2bd9ec0db47f tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:35.967772 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-21159d42-dc45-4330-8659-2bd9ec0db47f tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:36.109636 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ebf5998d-b33c-44c1-957c-24ff7e96c905 tempest-VolumesGetTestJSON-1952611164 tempest-VolumesGetTestJSON-1952611164-project] Action: 'create', calling method: .version_select at 0x7f98b05bd488>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1246253555", "metadata": {"Type": "work"}}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:37.079181 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ebf5998d-b33c-44c1-957c-24ff7e96c905 tempest-VolumesGetTestJSON-1952611164 tempest-VolumesGetTestJSON-1952611164-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.312647 Feb 17 03:27:37.080408 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 20/37] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Feb 17 03:27:35 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 1315 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Feb 17 03:27:37.085664 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cd2fea6d-156f-4ee7-9c0c-8f005ceefce5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:37.086552 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cd2fea6d-156f-4ee7-9c0c-8f005ceefce5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:37.095423 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cd2fea6d-156f-4ee7-9c0c-8f005ceefce5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:37.096227 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cd2fea6d-156f-4ee7-9c0c-8f005ceefce5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:37.097289 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cd2fea6d-156f-4ee7-9c0c-8f005ceefce5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:37.097988 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cd2fea6d-156f-4ee7-9c0c-8f005ceefce5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:39.022202 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-cd2fea6d-156f-4ee7-9c0c-8f005ceefce5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:39.039512 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cd2fea6d-156f-4ee7-9c0c-8f005ceefce5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1317 microversion: 2.1 time: 1.957712 Feb 17 03:27:39.040288 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 21/38] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:37 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1317 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:39.055979 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-53aeffb1-341b-4dd9-a720-63686db1773d tempest-VolumesGetTestJSON-1952611164 tempest-VolumesGetTestJSON-1952611164-project] Calling method '.version_select at 0x7f98b05c88c8>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:39.117746 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-21159d42-dc45-4330-8659-2bd9ec0db47f tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:39.142598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-21159d42-dc45-4330-8659-2bd9ec0db47f tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1315 microversion: 2.1 time: 3.227349 Feb 17 03:27:39.154218 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 18/39] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:35 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1315 bytes in 3239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:39.256821 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-53aeffb1-341b-4dd9-a720-63686db1773d tempest-VolumesGetTestJSON-1952611164 tempest-VolumesGetTestJSON-1952611164-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/add63bbf-a187-476d-ad0e-3ee5e7096b4f" status: 200 len: 354 microversion: 2.1 time: 0.212035 Feb 17 03:27:39.257660 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 22/40] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Feb 17 03:27:39 2021] GET /compute/v2.1/os-volumes/add63bbf-a187-476d-ad0e-3ee5e7096b4f => generated 354 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:39.270996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-01a6f267-146f-420f-95d9-6ee663b85f3a tempest-VolumesGetTestJSON-1952611164 tempest-VolumesGetTestJSON-1952611164-project] Calling method '.version_select at 0x7f98b05c8c80>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:39.294337 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a5c01c3a-d3c0-47c6-8acd-49a6c4e13bad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-515479100", "imageRef": "27891a64-31b3-4754-87b4-bf609a12c59a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "07c25ad2-4e60-4400-a677-ca2c2e7c85f8"}]}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:39.428652 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-a5c01c3a-d3c0-47c6-8acd-49a6c4e13bad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] validate_networks() for [('07c25ad2-4e60-4400-a677-ca2c2e7c85f8', None, None, None)] {{(pid=98103) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:27:39.547704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-01a6f267-146f-420f-95d9-6ee663b85f3a tempest-VolumesGetTestJSON-1952611164 tempest-VolumesGetTestJSON-1952611164-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/add63bbf-a187-476d-ad0e-3ee5e7096b4f" status: 200 len: 354 microversion: 2.1 time: 0.281161 Feb 17 03:27:39.548328 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 23/41] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Feb 17 03:27:39 2021] GET /compute/v2.1/os-volumes/add63bbf-a187-476d-ad0e-3ee5e7096b4f => generated 354 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:27:39.569985 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d9607629-2f84-4630-92ef-e41338064aa3 tempest-VolumesGetTestJSON-1952611164 tempest-VolumesGetTestJSON-1952611164-project] Calling method '.version_select at 0x7f98b05c8ea0>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:39.790146 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d9607629-2f84-4630-92ef-e41338064aa3 tempest-VolumesGetTestJSON-1952611164 tempest-VolumesGetTestJSON-1952611164-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/add63bbf-a187-476d-ad0e-3ee5e7096b4f" status: 202 len: 0 microversion: 2.1 time: 0.224182 Feb 17 03:27:39.790763 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 24/42] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Feb 17 03:27:39 2021] DELETE /compute/v2.1/os-volumes/add63bbf-a187-476d-ad0e-3ee5e7096b4f => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:27:39.801322 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-351dc224-21fd-4f10-b500-a2ac5bca828a tempest-VolumesGetTestJSON-1952611164 tempest-VolumesGetTestJSON-1952611164-project] Calling method '.version_select at 0x7f98b05bd2f0>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:40.065183 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-351dc224-21fd-4f10-b500-a2ac5bca828a tempest-VolumesGetTestJSON-1952611164 tempest-VolumesGetTestJSON-1952611164-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/add63bbf-a187-476d-ad0e-3ee5e7096b4f" status: 200 len: 353 microversion: 2.1 time: 0.269930 Feb 17 03:27:40.066954 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 25/43] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Feb 17 03:27:39 2021] GET /compute/v2.1/os-volumes/add63bbf-a187-476d-ad0e-3ee5e7096b4f => generated 353 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:27:40.082270 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bedb1830-9732-42d5-b4d7-d76f3331a2e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:40.083417 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bedb1830-9732-42d5-b4d7-d76f3331a2e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:40.094289 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bedb1830-9732-42d5-b4d7-d76f3331a2e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:40.095026 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bedb1830-9732-42d5-b4d7-d76f3331a2e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:40.096035 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bedb1830-9732-42d5-b4d7-d76f3331a2e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:40.097112 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bedb1830-9732-42d5-b4d7-d76f3331a2e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:40.696928 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bedb1830-9732-42d5-b4d7-d76f3331a2e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:40.715837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bedb1830-9732-42d5-b4d7-d76f3331a2e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1317 microversion: 2.1 time: 0.647055 Feb 17 03:27:40.726550 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 26/44] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:40 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1317 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:40.730140 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4cc6a91b-d357-4e79-a4f1-30ac37e723b9 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:40.730812 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4cc6a91b-d357-4e79-a4f1-30ac37e723b9 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:40.759007 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4cc6a91b-d357-4e79-a4f1-30ac37e723b9 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:40.759850 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4cc6a91b-d357-4e79-a4f1-30ac37e723b9 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:40.761520 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4cc6a91b-d357-4e79-a4f1-30ac37e723b9 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:40.762219 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4cc6a91b-d357-4e79-a4f1-30ac37e723b9 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:42.453541 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4cc6a91b-d357-4e79-a4f1-30ac37e723b9 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:42.463214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4cc6a91b-d357-4e79-a4f1-30ac37e723b9 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1315 microversion: 2.1 time: 1.740465 Feb 17 03:27:42.467536 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 27/45] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:40 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1315 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:42.478248 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f6e63236-9009-452b-bed4-b32291fdabab tempest-VolumesGetTestJSON-1952611164 tempest-VolumesGetTestJSON-1952611164-project] Calling method '.version_select at 0x7f98b05c87b8>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:42.629921 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-a5c01c3a-d3c0-47c6-8acd-49a6c4e13bad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:27:42.630516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-a5c01c3a-d3c0-47c6-8acd-49a6c4e13bad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:27:42.631197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-a5c01c3a-d3c0-47c6-8acd-49a6c4e13bad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:27:42.631771 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-a5c01c3a-d3c0-47c6-8acd-49a6c4e13bad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:27:42.632360 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-a5c01c3a-d3c0-47c6-8acd-49a6c4e13bad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:27:42.645551 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5c01c3a-d3c0-47c6-8acd-49a6c4e13bad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:42.650203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-f6e63236-9009-452b-bed4-b32291fdabab tempest-VolumesGetTestJSON-1952611164 tempest-VolumesGetTestJSON-1952611164-project] HTTP exception thrown: Volume add63bbf-a187-476d-ad0e-3ee5e7096b4f could not be found. Feb 17 03:27:42.651143 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f6e63236-9009-452b-bed4-b32291fdabab tempest-VolumesGetTestJSON-1952611164 tempest-VolumesGetTestJSON-1952611164-project] Returning 404 to user: Volume add63bbf-a187-476d-ad0e-3ee5e7096b4f could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:27:42.652160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f6e63236-9009-452b-bed4-b32291fdabab tempest-VolumesGetTestJSON-1952611164 tempest-VolumesGetTestJSON-1952611164-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/add63bbf-a187-476d-ad0e-3ee5e7096b4f" status: 404 len: 109 microversion: 2.1 time: 0.183418 Feb 17 03:27:42.652888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 28/46] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Feb 17 03:27:42 2021] GET /compute/v2.1/os-volumes/add63bbf-a187-476d-ad0e-3ee5e7096b4f => generated 109 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:27:42.657705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-98bc7207-198e-4852-b7b1-e709fed119de tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:42.658585 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-98bc7207-198e-4852-b7b1-e709fed119de tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:42.659585 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5c01c3a-d3c0-47c6-8acd-49a6c4e13bad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:42.662252 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5c01c3a-d3c0-47c6-8acd-49a6c4e13bad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:42.669690 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5c01c3a-d3c0-47c6-8acd-49a6c4e13bad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:42.689659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-98bc7207-198e-4852-b7b1-e709fed119de tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:42.690404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-98bc7207-198e-4852-b7b1-e709fed119de tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:42.692228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-98bc7207-198e-4852-b7b1-e709fed119de tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:42.696586 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-98bc7207-198e-4852-b7b1-e709fed119de tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:42.750196 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-a5c01c3a-d3c0-47c6-8acd-49a6c4e13bad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Getting quotas for project 8da7eb55c2cb47dc99275360edd183e2. Resources: {'ram', 'cores', 'instances'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:27:42.756796 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-a5c01c3a-d3c0-47c6-8acd-49a6c4e13bad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Getting quotas for user f3044252e900455594e84c1bac2a43cb and project 8da7eb55c2cb47dc99275360edd183e2. Resources: {'ram', 'cores', 'instances'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:27:42.789234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a5c01c3a-d3c0-47c6-8acd-49a6c4e13bad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Going to run 1 instances... {{(pid=98103) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:27:42.796272 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a5c01c3a-d3c0-47c6-8acd-49a6c4e13bad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27891a64-31b3-4754-87b4-bf609a12c59a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:27:42.912923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a5c01c3a-d3c0-47c6-8acd-49a6c4e13bad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.757095 Feb 17 03:27:42.922869 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 19/47] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:27:39 2021] POST /compute/v2.1/servers => generated 383 bytes in 3768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:27:42.934616 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-554676aa-d4ce-4048-8edd-1e638c1dce23 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:42.943273 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-554676aa-d4ce-4048-8edd-1e638c1dce23 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:43.286649 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-554676aa-d4ce-4048-8edd-1e638c1dce23 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:43.305370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-554676aa-d4ce-4048-8edd-1e638c1dce23 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1221 microversion: 2.1 time: 0.374629 Feb 17 03:27:43.308025 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 20/48] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:42 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1221 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:43.484066 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-98bc7207-198e-4852-b7b1-e709fed119de tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:43.484567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5fa07277-5f0d-45bd-9b36-ba4e200f9be3 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:43.485254 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5fa07277-5f0d-45bd-9b36-ba4e200f9be3 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:43.493447 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-98bc7207-198e-4852-b7b1-e709fed119de tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1317 microversion: 2.1 time: 0.839270 Feb 17 03:27:43.494046 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 29/49] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:42 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1317 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:43.504994 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5fa07277-5f0d-45bd-9b36-ba4e200f9be3 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:43.506357 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5fa07277-5f0d-45bd-9b36-ba4e200f9be3 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:43.511723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5fa07277-5f0d-45bd-9b36-ba4e200f9be3 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:43.512370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5fa07277-5f0d-45bd-9b36-ba4e200f9be3 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:43.594444 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4d0ec089-6b90-4901-9ebc-8b945007b728 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-413632406", "imageRef": "27891a64-31b3-4754-87b4-bf609a12c59a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "07c25ad2-4e60-4400-a677-ca2c2e7c85f8"}]}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:43.859758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-4d0ec089-6b90-4901-9ebc-8b945007b728 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] validate_networks() for [('07c25ad2-4e60-4400-a677-ca2c2e7c85f8', None, None, None)] {{(pid=98104) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:27:45.714064 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5fa07277-5f0d-45bd-9b36-ba4e200f9be3 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:45.737371 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5fa07277-5f0d-45bd-9b36-ba4e200f9be3 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1315 microversion: 2.1 time: 2.255788 Feb 17 03:27:45.739088 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 21/50] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:43 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1315 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:45.751342 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b9237163-2a86-46fc-a79a-712287e5441f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:45.759450 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b9237163-2a86-46fc-a79a-712287e5441f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:45.781475 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b9237163-2a86-46fc-a79a-712287e5441f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:45.782338 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b9237163-2a86-46fc-a79a-712287e5441f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:45.784047 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b9237163-2a86-46fc-a79a-712287e5441f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:45.785920 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b9237163-2a86-46fc-a79a-712287e5441f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:46.069124 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-4d0ec089-6b90-4901-9ebc-8b945007b728 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Flavor limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:27:46.070263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-4d0ec089-6b90-4901-9ebc-8b945007b728 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Image limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:27:46.071341 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-4d0ec089-6b90-4901-9ebc-8b945007b728 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Flavor pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:27:46.072039 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-4d0ec089-6b90-4901-9ebc-8b945007b728 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Image pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:27:46.073219 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-4d0ec089-6b90-4901-9ebc-8b945007b728 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:27:46.099494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4d0ec089-6b90-4901-9ebc-8b945007b728 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:46.099494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4d0ec089-6b90-4901-9ebc-8b945007b728 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:46.099787 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4d0ec089-6b90-4901-9ebc-8b945007b728 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:46.100615 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4d0ec089-6b90-4901-9ebc-8b945007b728 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:46.121735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-4d0ec089-6b90-4901-9ebc-8b945007b728 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Getting quotas for project 8da7eb55c2cb47dc99275360edd183e2. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:27:46.127420 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-4d0ec089-6b90-4901-9ebc-8b945007b728 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Getting quotas for user f3044252e900455594e84c1bac2a43cb and project 8da7eb55c2cb47dc99275360edd183e2. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:27:46.143348 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4d0ec089-6b90-4901-9ebc-8b945007b728 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Going to run 1 instances... {{(pid=98104) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:27:46.147155 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4d0ec089-6b90-4901-9ebc-8b945007b728 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27891a64-31b3-4754-87b4-bf609a12c59a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:27:46.216165 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4d0ec089-6b90-4901-9ebc-8b945007b728 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.626557 Feb 17 03:27:46.217022 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 30/51] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:27:43 2021] POST /compute/v2.1/servers => generated 383 bytes in 2628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 17 03:27:46.609109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-31122903-eda4-423b-a340-01ed736a8264 req-79b62c8f-29b1-47e2-99b2-a0dd5dc83b02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a792992-ad2a-408d-9e19-9363ed0b0c51", "tag": "8783865b-a078-4448-ad74-449c2887c2a3"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:46.611645 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:46.611645 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:27:46.630359 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-31122903-eda4-423b-a340-01ed736a8264 req-79b62c8f-29b1-47e2-99b2-a0dd5dc83b02 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:46.630861 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-31122903-eda4-423b-a340-01ed736a8264 req-79b62c8f-29b1-47e2-99b2-a0dd5dc83b02 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:46.671945 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-31122903-eda4-423b-a340-01ed736a8264 req-79b62c8f-29b1-47e2-99b2-a0dd5dc83b02 service nova] Creating event network-changed:8783865b-a078-4448-ad74-449c2887c2a3 for instance 5a792992-ad2a-408d-9e19-9363ed0b0c51 on hv-cinder-75994 Feb 17 03:27:46.672529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-31122903-eda4-423b-a340-01ed736a8264 req-79b62c8f-29b1-47e2-99b2-a0dd5dc83b02 service nova] Acquired lock "compute-rpcapi-router" {{(pid=98104) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:27:46.681548 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-faf422fd-25db-416c-898d-f89e61a315d1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:46.682296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-faf422fd-25db-416c-898d-f89e61a315d1 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:46.685585 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-faf422fd-25db-416c-898d-f89e61a315d1 None None] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:46.686264 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-faf422fd-25db-416c-898d-f89e61a315d1 None None] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:46.710404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.compute.rpcapi [None req-faf422fd-25db-416c-898d-f89e61a315d1 None None] Automatically selected compute RPC version 5.13 from minimum service version 54 Feb 17 03:27:46.713922 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-faf422fd-25db-416c-898d-f89e61a315d1 None None] Releasing lock "compute-rpcapi-router" {{(pid=98104) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:27:46.777219 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-faf422fd-25db-416c-898d-f89e61a315d1 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.558777 Feb 17 03:27:46.777844 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 31/52] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:46.783575 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4d49db48-d5a3-4460-ae43-a554d144e0bf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:46.784508 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4d49db48-d5a3-4460-ae43-a554d144e0bf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:47.186634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4d49db48-d5a3-4460-ae43-a554d144e0bf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:47.206998 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4d49db48-d5a3-4460-ae43-a554d144e0bf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1221 microversion: 2.1 time: 0.425789 Feb 17 03:27:47.209637 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 32/53] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:46 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1221 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:47.226906 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b62710c7-5111-4cb5-b0da-cfaef76b64cf tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:47.227839 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b62710c7-5111-4cb5-b0da-cfaef76b64cf tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:47.244154 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b62710c7-5111-4cb5-b0da-cfaef76b64cf tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:47.245258 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b62710c7-5111-4cb5-b0da-cfaef76b64cf tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:47.262663 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b62710c7-5111-4cb5-b0da-cfaef76b64cf tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:47.263574 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b62710c7-5111-4cb5-b0da-cfaef76b64cf tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:48.000263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b9237163-2a86-46fc-a79a-712287e5441f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:48.014593 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b9237163-2a86-46fc-a79a-712287e5441f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1317 microversion: 2.1 time: 2.269168 Feb 17 03:27:48.014593 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 22/54] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:45 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1317 bytes in 2271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:48.030104 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b62710c7-5111-4cb5-b0da-cfaef76b64cf tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:48.042296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b62710c7-5111-4cb5-b0da-cfaef76b64cf tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1315 microversion: 2.1 time: 0.831300 Feb 17 03:27:48.043359 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 33/55] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:47 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:48.227220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9b6f84dc-2609-4f66-be40-b9656303ac75 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:48.227891 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9b6f84dc-2609-4f66-be40-b9656303ac75 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:48.248317 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9b6f84dc-2609-4f66-be40-b9656303ac75 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:48.248826 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9b6f84dc-2609-4f66-be40-b9656303ac75 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:48.249706 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9b6f84dc-2609-4f66-be40-b9656303ac75 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:48.250191 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9b6f84dc-2609-4f66-be40-b9656303ac75 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:48.793541 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9b6f84dc-2609-4f66-be40-b9656303ac75 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:48.812134 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9b6f84dc-2609-4f66-be40-b9656303ac75 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1281 microversion: 2.1 time: 0.585633 Feb 17 03:27:48.812934 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 23/56] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:48 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1281 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:49.030896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5b238b6c-7c11-4ee5-a414-762a774875fc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:49.031732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5b238b6c-7c11-4ee5-a414-762a774875fc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:49.047077 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5b238b6c-7c11-4ee5-a414-762a774875fc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:49.050924 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5b238b6c-7c11-4ee5-a414-762a774875fc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:49.052616 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5b238b6c-7c11-4ee5-a414-762a774875fc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:49.053523 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5b238b6c-7c11-4ee5-a414-762a774875fc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:49.435703 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-838c67bc-e288-42e8-b3eb-b1a5bca7305a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'create', calling method: .version_select at 0x7f98b05c8b70>, body: {"keypair": {"name": "tempest-keypair-93764289"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:49.494377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-838c67bc-e288-42e8-b3eb-b1a5bca7305a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Getting quotas for project 64044155addf41e9ba2bde5782afed2a. Resources: {'key_pairs'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:27:49.504593 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-838c67bc-e288-42e8-b3eb-b1a5bca7305a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Getting quotas for user d89f687506dc43c6b64ec46ad1396b2e and project 64044155addf41e9ba2bde5782afed2a. Resources: {'key_pairs'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:27:49.826133 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-838c67bc-e288-42e8-b3eb-b1a5bca7305a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Getting quotas for project 64044155addf41e9ba2bde5782afed2a. Resources: {'key_pairs'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:27:49.842545 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-838c67bc-e288-42e8-b3eb-b1a5bca7305a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Getting quotas for user d89f687506dc43c6b64ec46ad1396b2e and project 64044155addf41e9ba2bde5782afed2a. Resources: {'key_pairs'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:27:49.870481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-838c67bc-e288-42e8-b3eb-b1a5bca7305a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 2318 microversion: 2.20 time: 0.879693 Feb 17 03:27:49.871626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 34/57] 10.222.0.57 () {62 vars in 1189 bytes} [Wed Feb 17 03:27:48 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 881 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 17 03:27:49.876549 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-dbebedc9-001e-4817-b407-12d489c7682d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:49.883059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-dbebedc9-001e-4817-b407-12d489c7682d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:49.910782 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dbebedc9-001e-4817-b407-12d489c7682d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:49.911394 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dbebedc9-001e-4817-b407-12d489c7682d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:49.912431 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dbebedc9-001e-4817-b407-12d489c7682d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:49.913128 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dbebedc9-001e-4817-b407-12d489c7682d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:50.197216 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5b238b6c-7c11-4ee5-a414-762a774875fc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:50.211411 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5b238b6c-7c11-4ee5-a414-762a774875fc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1317 microversion: 2.1 time: 1.184684 Feb 17 03:27:50.211997 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 24/58] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:49 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1317 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:50.226118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e92d8806-fcc2-43f7-a37a-1690ccb310d6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:50.226898 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e92d8806-fcc2-43f7-a37a-1690ccb310d6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:50.243931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e92d8806-fcc2-43f7-a37a-1690ccb310d6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:50.244700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e92d8806-fcc2-43f7-a37a-1690ccb310d6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:50.247528 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e92d8806-fcc2-43f7-a37a-1690ccb310d6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:50.248240 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e92d8806-fcc2-43f7-a37a-1690ccb310d6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:50.920109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e92d8806-fcc2-43f7-a37a-1690ccb310d6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:50.936727 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e92d8806-fcc2-43f7-a37a-1690ccb310d6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1279 microversion: 2.1 time: 0.721671 Feb 17 03:27:50.937555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 25/59] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:50 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1279 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:51.262455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-39860156-dccc-46d8-9c85-655d99a5f951 req-44ec8cc4-8a81-45e5-b6fa-5b89d49167ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05b5b64f-7a56-4bd2-97ed-2e54c9e65a96", "tag": "a22a3785-c250-4a30-9d0e-f779f4acfbdd"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:51.264799 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:51.264799 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:27:51.285474 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-39860156-dccc-46d8-9c85-655d99a5f951 req-44ec8cc4-8a81-45e5-b6fa-5b89d49167ba service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:51.285975 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-39860156-dccc-46d8-9c85-655d99a5f951 req-44ec8cc4-8a81-45e5-b6fa-5b89d49167ba service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:51.322412 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-39860156-dccc-46d8-9c85-655d99a5f951 req-44ec8cc4-8a81-45e5-b6fa-5b89d49167ba service nova] Creating event network-changed:a22a3785-c250-4a30-9d0e-f779f4acfbdd for instance 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 on hv-cinder-75994 Feb 17 03:27:51.333783 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-39860156-dccc-46d8-9c85-655d99a5f951 req-44ec8cc4-8a81-45e5-b6fa-5b89d49167ba service nova] Acquired lock "compute-rpcapi-router" {{(pid=98103) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:27:51.335180 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7fb8ef20-9d04-4705-8095-5c518853b32d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:51.335672 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7fb8ef20-9d04-4705-8095-5c518853b32d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:51.336704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7fb8ef20-9d04-4705-8095-5c518853b32d None None] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:51.337376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7fb8ef20-9d04-4705-8095-5c518853b32d None None] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:51.356105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.compute.rpcapi [None req-7fb8ef20-9d04-4705-8095-5c518853b32d None None] Automatically selected compute RPC version 5.13 from minimum service version 54 Feb 17 03:27:51.357378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7fb8ef20-9d04-4705-8095-5c518853b32d None None] Releasing lock "compute-rpcapi-router" {{(pid=98103) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:27:51.418142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7fb8ef20-9d04-4705-8095-5c518853b32d None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.477964 Feb 17 03:27:51.419132 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 26/60] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:27:51.425944 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-97f56b3e-6ba4-4345-b858-2c9f869d384c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:51.426898 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-97f56b3e-6ba4-4345-b858-2c9f869d384c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:51.438681 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-97f56b3e-6ba4-4345-b858-2c9f869d384c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:51.439627 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-97f56b3e-6ba4-4345-b858-2c9f869d384c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:51.440820 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-97f56b3e-6ba4-4345-b858-2c9f869d384c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:51.441936 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-97f56b3e-6ba4-4345-b858-2c9f869d384c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:51.899200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dbebedc9-001e-4817-b407-12d489c7682d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:51.909062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-dbebedc9-001e-4817-b407-12d489c7682d tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1315 microversion: 2.1 time: 2.036120 Feb 17 03:27:51.909660 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 35/61] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:49 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1315 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:51.956377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6eccf3b5-fad4-47b7-af04-0775255b5254 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:51.957372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6eccf3b5-fad4-47b7-af04-0775255b5254 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:51.976326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6eccf3b5-fad4-47b7-af04-0775255b5254 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:51.977893 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6eccf3b5-fad4-47b7-af04-0775255b5254 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:51.979415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6eccf3b5-fad4-47b7-af04-0775255b5254 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:51.981443 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6eccf3b5-fad4-47b7-af04-0775255b5254 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:52.604891 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6eccf3b5-fad4-47b7-af04-0775255b5254 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:52.628920 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6eccf3b5-fad4-47b7-af04-0775255b5254 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1279 microversion: 2.1 time: 0.676766 Feb 17 03:27:52.629570 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 36/62] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:51 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1279 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:52.859300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-97f56b3e-6ba4-4345-b858-2c9f869d384c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:52.871830 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-97f56b3e-6ba4-4345-b858-2c9f869d384c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1317 microversion: 2.1 time: 1.450876 Feb 17 03:27:52.872413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 27/63] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:51 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1317 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:52.927992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-64269a01-cba7-4ab5-9b13-b6ba3fda69b5 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:52.928976 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-64269a01-cba7-4ab5-9b13-b6ba3fda69b5 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:52.944270 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-64269a01-cba7-4ab5-9b13-b6ba3fda69b5 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:52.949944 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-64269a01-cba7-4ab5-9b13-b6ba3fda69b5 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:52.951356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-64269a01-cba7-4ab5-9b13-b6ba3fda69b5 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:52.952032 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-64269a01-cba7-4ab5-9b13-b6ba3fda69b5 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:53.648236 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e680bcee-4a6e-424e-ab2f-a8c85f11ec85 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:53.648904 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e680bcee-4a6e-424e-ab2f-a8c85f11ec85 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:53.662464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e680bcee-4a6e-424e-ab2f-a8c85f11ec85 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:53.662967 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e680bcee-4a6e-424e-ab2f-a8c85f11ec85 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:53.663802 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e680bcee-4a6e-424e-ab2f-a8c85f11ec85 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:53.677156 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e680bcee-4a6e-424e-ab2f-a8c85f11ec85 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:54.030306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e680bcee-4a6e-424e-ab2f-a8c85f11ec85 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:54.041661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e680bcee-4a6e-424e-ab2f-a8c85f11ec85 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.397627 Feb 17 03:27:54.044810 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 28/64] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:53 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:54.372088 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-06ac41f7-29ea-4705-9915-f58e4fa73757 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'create', calling method: .version_select at 0x7f98b45a4e18>, body: {"keypair": {"name": "tempest-keypair-1174879166"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:54.388335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-64269a01-cba7-4ab5-9b13-b6ba3fda69b5 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:54.399469 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-64269a01-cba7-4ab5-9b13-b6ba3fda69b5 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1315 microversion: 2.1 time: 1.475929 Feb 17 03:27:54.405406 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 37/65] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:52 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1315 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:54.408076 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-06ac41f7-29ea-4705-9915-f58e4fa73757 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Getting quotas for project c568344bec0146c19c14571bff20a759. Resources: {'key_pairs'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:27:54.410749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1c218e85-538a-4224-a527-3f2dd94c692b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:54.411415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1c218e85-538a-4224-a527-3f2dd94c692b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:54.412948 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-06ac41f7-29ea-4705-9915-f58e4fa73757 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Getting quotas for user f60e8201ff554fefa20487ac8f981d07 and project c568344bec0146c19c14571bff20a759. Resources: {'key_pairs'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:27:54.435373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1c218e85-538a-4224-a527-3f2dd94c692b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:54.436835 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1c218e85-538a-4224-a527-3f2dd94c692b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:54.440039 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1c218e85-538a-4224-a527-3f2dd94c692b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:54.440691 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1c218e85-538a-4224-a527-3f2dd94c692b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:54.717990 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-06ac41f7-29ea-4705-9915-f58e4fa73757 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Getting quotas for project c568344bec0146c19c14571bff20a759. Resources: {'key_pairs'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:27:54.723337 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-06ac41f7-29ea-4705-9915-f58e4fa73757 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Getting quotas for user f60e8201ff554fefa20487ac8f981d07 and project c568344bec0146c19c14571bff20a759. Resources: {'key_pairs'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:27:54.738423 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-06ac41f7-29ea-4705-9915-f58e4fa73757 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.692329 Feb 17 03:27:54.739255 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 29/66] 10.222.0.57 () {60 vars in 1148 bytes} [Wed Feb 17 03:27:54 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:55.060720 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-437ef3b5-df4d-4d6f-969f-9a98fd8c7370 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:55.061780 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-437ef3b5-df4d-4d6f-969f-9a98fd8c7370 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:55.083181 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-437ef3b5-df4d-4d6f-969f-9a98fd8c7370 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:55.083681 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-437ef3b5-df4d-4d6f-969f-9a98fd8c7370 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:55.084558 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-437ef3b5-df4d-4d6f-969f-9a98fd8c7370 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:55.085067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-437ef3b5-df4d-4d6f-969f-9a98fd8c7370 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:55.396354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1c218e85-538a-4224-a527-3f2dd94c692b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:55.407211 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1c218e85-538a-4224-a527-3f2dd94c692b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1317 microversion: 2.1 time: 1.000603 Feb 17 03:27:55.408095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 38/67] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:54 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1317 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:55.425829 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-287c3704-2797-468a-8bd6-30523a7318bd tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:55.426663 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-287c3704-2797-468a-8bd6-30523a7318bd tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:55.434755 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-287c3704-2797-468a-8bd6-30523a7318bd tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:55.435419 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-287c3704-2797-468a-8bd6-30523a7318bd tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:55.436407 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-287c3704-2797-468a-8bd6-30523a7318bd tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:55.437049 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-287c3704-2797-468a-8bd6-30523a7318bd tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:55.905874 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-437ef3b5-df4d-4d6f-969f-9a98fd8c7370 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:55.919029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-437ef3b5-df4d-4d6f-969f-9a98fd8c7370 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.862928 Feb 17 03:27:55.923048 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 30/68] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:55 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:27:56.018339 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-287c3704-2797-468a-8bd6-30523a7318bd tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:56.037877 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-287c3704-2797-468a-8bd6-30523a7318bd tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1315 microversion: 2.1 time: 0.613965 Feb 17 03:27:56.040704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 39/69] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:55 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:56.428077 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2031ea11-13f5-4dac-bab5-54605b3491df tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:56.429448 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2031ea11-13f5-4dac-bab5-54605b3491df tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:56.453772 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2031ea11-13f5-4dac-bab5-54605b3491df tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:56.460621 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2031ea11-13f5-4dac-bab5-54605b3491df tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:56.463584 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2031ea11-13f5-4dac-bab5-54605b3491df tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:56.467978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2031ea11-13f5-4dac-bab5-54605b3491df tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:56.732060 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-3807c84d-1eac-4757-9def-3a37fa739551 req-3bc60f92-6576-4a3f-aad1-b450dfd00f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4d58358-22a0-4562-9370-9574a29ec572", "tag": "d5ada634-5cb7-40f0-b70e-0091b83e2ef6"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:27:56.734316 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:27:56.734316 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:27:56.755450 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-3807c84d-1eac-4757-9def-3a37fa739551 req-3bc60f92-6576-4a3f-aad1-b450dfd00f9c service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:56.762926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-3807c84d-1eac-4757-9def-3a37fa739551 req-3bc60f92-6576-4a3f-aad1-b450dfd00f9c service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:56.801443 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-3807c84d-1eac-4757-9def-3a37fa739551 req-3bc60f92-6576-4a3f-aad1-b450dfd00f9c service nova] Creating event network-changed:d5ada634-5cb7-40f0-b70e-0091b83e2ef6 for instance b4d58358-22a0-4562-9370-9574a29ec572 on hv-cinder-75994 Feb 17 03:27:56.819400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-3807c84d-1eac-4757-9def-3a37fa739551 req-3bc60f92-6576-4a3f-aad1-b450dfd00f9c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091992 Feb 17 03:27:56.819948 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 40/70] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:27:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:27:56.942428 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-997ca021-8c76-4bb4-8671-1440f8d29675 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:56.944203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-997ca021-8c76-4bb4-8671-1440f8d29675 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:56.953160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-997ca021-8c76-4bb4-8671-1440f8d29675 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:56.953907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-997ca021-8c76-4bb4-8671-1440f8d29675 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:56.954936 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-997ca021-8c76-4bb4-8671-1440f8d29675 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:56.955611 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-997ca021-8c76-4bb4-8671-1440f8d29675 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:58.080842 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-997ca021-8c76-4bb4-8671-1440f8d29675 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:58.089358 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-997ca021-8c76-4bb4-8671-1440f8d29675 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 1.151430 Feb 17 03:27:58.089972 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 41/71] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:56 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:58.108984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-22f2edbd-9e54-4a44-a174-7a39e5febfc1 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:58.110813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-22f2edbd-9e54-4a44-a174-7a39e5febfc1 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:58.127864 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-22f2edbd-9e54-4a44-a174-7a39e5febfc1 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:58.128364 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-22f2edbd-9e54-4a44-a174-7a39e5febfc1 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:58.129767 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-22f2edbd-9e54-4a44-a174-7a39e5febfc1 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:58.130814 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-22f2edbd-9e54-4a44-a174-7a39e5febfc1 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:58.243871 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2031ea11-13f5-4dac-bab5-54605b3491df tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:58.264866 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2031ea11-13f5-4dac-bab5-54605b3491df tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1317 microversion: 2.1 time: 1.837216 Feb 17 03:27:58.286929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 31/72] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:56 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1317 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:59.107896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bd0d6432-cb65-4f7e-9c33-b2c6dd305959 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:59.109376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bd0d6432-cb65-4f7e-9c33-b2c6dd305959 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:59.130276 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bd0d6432-cb65-4f7e-9c33-b2c6dd305959 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:59.132042 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bd0d6432-cb65-4f7e-9c33-b2c6dd305959 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:59.133942 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bd0d6432-cb65-4f7e-9c33-b2c6dd305959 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:59.134572 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bd0d6432-cb65-4f7e-9c33-b2c6dd305959 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:59.332179 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-22f2edbd-9e54-4a44-a174-7a39e5febfc1 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:27:59.351691 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-22f2edbd-9e54-4a44-a174-7a39e5febfc1 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1315 microversion: 2.1 time: 1.260579 Feb 17 03:27:59.352497 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 42/73] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:58 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1315 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:27:59.361451 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a55d6b6c-8821-44e0-9977-09c1e6fe6d0d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:27:59.363602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a55d6b6c-8821-44e0-9977-09c1e6fe6d0d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:27:59.372917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a55d6b6c-8821-44e0-9977-09c1e6fe6d0d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:59.373746 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a55d6b6c-8821-44e0-9977-09c1e6fe6d0d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:27:59.375187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a55d6b6c-8821-44e0-9977-09c1e6fe6d0d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:27:59.376063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a55d6b6c-8821-44e0-9977-09c1e6fe6d0d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:00.148306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bd0d6432-cb65-4f7e-9c33-b2c6dd305959 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:00.166758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bd0d6432-cb65-4f7e-9c33-b2c6dd305959 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 1.062996 Feb 17 03:28:00.169589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 32/74] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:59 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:00.343423 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a55d6b6c-8821-44e0-9977-09c1e6fe6d0d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:00.360283 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a55d6b6c-8821-44e0-9977-09c1e6fe6d0d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1317 microversion: 2.1 time: 1.000080 Feb 17 03:28:00.361330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 43/75] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:27:59 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1317 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:00.372444 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c1a21fd3-fe26-486f-ba45-1f8e944d0a7e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:00.374979 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c1a21fd3-fe26-486f-ba45-1f8e944d0a7e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:00.397145 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c1a21fd3-fe26-486f-ba45-1f8e944d0a7e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:00.399221 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c1a21fd3-fe26-486f-ba45-1f8e944d0a7e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:00.402904 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c1a21fd3-fe26-486f-ba45-1f8e944d0a7e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:00.403581 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c1a21fd3-fe26-486f-ba45-1f8e944d0a7e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:00.608011 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-9b9cd07e-f1db-4101-b6ac-88d235c118c3 req-795bed34-85dd-49fb-8bc2-a1861e0bcbca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a792992-ad2a-408d-9e19-9363ed0b0c51", "name": "network-vif-plugged", "status": "completed", "tag": "8783865b-a078-4448-ad74-449c2887c2a3"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:00.610016 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:00.610016 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:28:00.619589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-9b9cd07e-f1db-4101-b6ac-88d235c118c3 req-795bed34-85dd-49fb-8bc2-a1861e0bcbca service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:00.620336 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-9b9cd07e-f1db-4101-b6ac-88d235c118c3 req-795bed34-85dd-49fb-8bc2-a1861e0bcbca service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:00.644026 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-9b9cd07e-f1db-4101-b6ac-88d235c118c3 req-795bed34-85dd-49fb-8bc2-a1861e0bcbca service nova] Creating event network-vif-plugged:8783865b-a078-4448-ad74-449c2887c2a3 for instance 5a792992-ad2a-408d-9e19-9363ed0b0c51 on hv-cinder-75994 Feb 17 03:28:00.665743 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-9b9cd07e-f1db-4101-b6ac-88d235c118c3 req-795bed34-85dd-49fb-8bc2-a1861e0bcbca service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.482116 Feb 17 03:28:00.667410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 33/76] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:00.673347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-71c95eb2-b0fc-490a-a26f-c0514823c82f req-d87ec502-c49a-4f47-91f1-a3e881a96480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d4f9c42-f07a-4f40-aad4-702d0fd26d82", "tag": "c4b7f0c6-bfe4-49e1-936d-f15129c212a8"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:00.675569 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:00.675569 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:28:00.688525 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-71c95eb2-b0fc-490a-a26f-c0514823c82f req-d87ec502-c49a-4f47-91f1-a3e881a96480 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:00.689362 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-71c95eb2-b0fc-490a-a26f-c0514823c82f req-d87ec502-c49a-4f47-91f1-a3e881a96480 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:00.710131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-71c95eb2-b0fc-490a-a26f-c0514823c82f req-d87ec502-c49a-4f47-91f1-a3e881a96480 service nova] Creating event network-changed:c4b7f0c6-bfe4-49e1-936d-f15129c212a8 for instance 4d4f9c42-f07a-4f40-aad4-702d0fd26d82 on hv-cinder-75994 Feb 17 03:28:00.716821 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-71c95eb2-b0fc-490a-a26f-c0514823c82f req-d87ec502-c49a-4f47-91f1-a3e881a96480 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047753 Feb 17 03:28:00.720896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 34/77] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:00.821508 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ecdd4816-a0ce-4016-8445-225a7fb72287 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1140324729", "imageRef": "27891a64-31b3-4754-87b4-bf609a12c59a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "735791d7-b752-470f-b049-6623a91713f5"}], "security_groups": [{"name": "tempest-securitygroup--1022157144"}], "key_name": "tempest-keypair-93764289", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:01.830764 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c1a21fd3-fe26-486f-ba45-1f8e944d0a7e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:01.844172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c1a21fd3-fe26-486f-ba45-1f8e944d0a7e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1315 microversion: 2.1 time: 1.477320 Feb 17 03:28:01.845382 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 44/78] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:00 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1315 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:01.850279 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-475109fc-b328-4ca9-b898-47f5eb8417fb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:01.859607 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-475109fc-b328-4ca9-b898-47f5eb8417fb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:01.880769 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-475109fc-b328-4ca9-b898-47f5eb8417fb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:01.881332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-475109fc-b328-4ca9-b898-47f5eb8417fb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:01.882290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-475109fc-b328-4ca9-b898-47f5eb8417fb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:01.882814 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-475109fc-b328-4ca9-b898-47f5eb8417fb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:02.078723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-ecdd4816-a0ce-4016-8445-225a7fb72287 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] validate_networks() for [('735791d7-b752-470f-b049-6623a91713f5', None, None, None)] {{(pid=98103) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:28:02.367605 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-475109fc-b328-4ca9-b898-47f5eb8417fb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:02.377539 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-475109fc-b328-4ca9-b898-47f5eb8417fb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.530863 Feb 17 03:28:02.378586 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 45/79] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:01 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:02.383841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-921f86a1-6e04-4954-8f5e-ee53328f8296 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:02.384596 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-921f86a1-6e04-4954-8f5e-ee53328f8296 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:02.392368 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-921f86a1-6e04-4954-8f5e-ee53328f8296 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:02.392934 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-921f86a1-6e04-4954-8f5e-ee53328f8296 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:02.393981 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-921f86a1-6e04-4954-8f5e-ee53328f8296 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:02.394687 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-921f86a1-6e04-4954-8f5e-ee53328f8296 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:02.830848 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-921f86a1-6e04-4954-8f5e-ee53328f8296 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:02.841960 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-921f86a1-6e04-4954-8f5e-ee53328f8296 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1317 microversion: 2.1 time: 0.461802 Feb 17 03:28:02.842575 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 46/80] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:02 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:02.849674 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-3da1fa17-3438-46f3-908a-9a994e4e779f req-e7a8a60f-d8a8-43d3-8962-1ffc486554a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05b5b64f-7a56-4bd2-97ed-2e54c9e65a96", "name": "network-vif-plugged", "status": "completed", "tag": "a22a3785-c250-4a30-9d0e-f779f4acfbdd"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:02.851705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:02.851705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:28:02.864711 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-3da1fa17-3438-46f3-908a-9a994e4e779f req-e7a8a60f-d8a8-43d3-8962-1ffc486554a2 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:02.865562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-3da1fa17-3438-46f3-908a-9a994e4e779f req-e7a8a60f-d8a8-43d3-8962-1ffc486554a2 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:02.885715 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-3da1fa17-3438-46f3-908a-9a994e4e779f req-e7a8a60f-d8a8-43d3-8962-1ffc486554a2 service nova] Creating event network-vif-plugged:a22a3785-c250-4a30-9d0e-f779f4acfbdd for instance 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 on hv-cinder-75994 Feb 17 03:28:02.891820 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-3da1fa17-3438-46f3-908a-9a994e4e779f req-e7a8a60f-d8a8-43d3-8962-1ffc486554a2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046458 Feb 17 03:28:02.892839 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 47/81] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:02.903646 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-26c0f421-f08b-4159-b392-60ed08661763 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:02.904643 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-26c0f421-f08b-4159-b392-60ed08661763 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:02.914181 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-26c0f421-f08b-4159-b392-60ed08661763 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:02.915058 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-26c0f421-f08b-4159-b392-60ed08661763 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:02.916229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-26c0f421-f08b-4159-b392-60ed08661763 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:02.916935 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-26c0f421-f08b-4159-b392-60ed08661763 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:03.481156 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-26c0f421-f08b-4159-b392-60ed08661763 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:03.491089 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-26c0f421-f08b-4159-b392-60ed08661763 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1315 microversion: 2.1 time: 0.593755 Feb 17 03:28:03.501240 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 48/82] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:02 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:03.501240 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-62352fcb-b27a-43b4-b332-0cdc2c59fdc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1284451421", "imageRef": "27891a64-31b3-4754-87b4-bf609a12c59a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "196dd25e-6f79-49ea-bd1a-b88102e9bbe7"}], "security_groups": [{"name": "tempest-securitygroup--918275720"}], "key_name": "tempest-keypair-1174879166", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:03.725589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-62352fcb-b27a-43b4-b332-0cdc2c59fdc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] validate_networks() for [('196dd25e-6f79-49ea-bd1a-b88102e9bbe7', None, None, None)] {{(pid=98104) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:28:03.787008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-ecdd4816-a0ce-4016-8445-225a7fb72287 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:28:03.787542 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-ecdd4816-a0ce-4016-8445-225a7fb72287 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:28:03.788290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-ecdd4816-a0ce-4016-8445-225a7fb72287 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:28:03.788759 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-ecdd4816-a0ce-4016-8445-225a7fb72287 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:28:03.789428 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-ecdd4816-a0ce-4016-8445-225a7fb72287 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:28:03.799118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ecdd4816-a0ce-4016-8445-225a7fb72287 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:03.799677 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ecdd4816-a0ce-4016-8445-225a7fb72287 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:03.800557 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ecdd4816-a0ce-4016-8445-225a7fb72287 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:03.801055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ecdd4816-a0ce-4016-8445-225a7fb72287 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:03.820164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-ecdd4816-a0ce-4016-8445-225a7fb72287 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Getting quotas for project 64044155addf41e9ba2bde5782afed2a. Resources: {'ram', 'cores', 'instances'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:28:03.826129 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-ecdd4816-a0ce-4016-8445-225a7fb72287 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Getting quotas for user d89f687506dc43c6b64ec46ad1396b2e and project 64044155addf41e9ba2bde5782afed2a. Resources: {'ram', 'cores', 'instances'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:28:03.838924 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ecdd4816-a0ce-4016-8445-225a7fb72287 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Going to run 1 instances... {{(pid=98103) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:28:03.841676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ecdd4816-a0ce-4016-8445-225a7fb72287 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27891a64-31b3-4754-87b4-bf609a12c59a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:28:03.966227 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ecdd4816-a0ce-4016-8445-225a7fb72287 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.148588 Feb 17 03:28:03.966227 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 35/83] 10.222.0.57 () {62 vars in 1178 bytes} [Wed Feb 17 03:28:00 2021] POST /compute/v2.1/servers => generated 402 bytes in 3150 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 17 03:28:03.996401 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0065eede-1797-4dcb-b876-139b1994a2c9 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:03.997344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0065eede-1797-4dcb-b876-139b1994a2c9 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:04.021289 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0065eede-1797-4dcb-b876-139b1994a2c9 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:04.021773 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0065eede-1797-4dcb-b876-139b1994a2c9 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:04.025946 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0065eede-1797-4dcb-b876-139b1994a2c9 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:04.026921 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0065eede-1797-4dcb-b876-139b1994a2c9 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:04.448113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0065eede-1797-4dcb-b876-139b1994a2c9 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:04.461978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0065eede-1797-4dcb-b876-139b1994a2c9 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.479091 Feb 17 03:28:04.464055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 36/84] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:03 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:04.472662 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-589456e6-f376-444e-8b62-d7173bd6fe56 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:04.479544 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-589456e6-f376-444e-8b62-d7173bd6fe56 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:04.495033 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-589456e6-f376-444e-8b62-d7173bd6fe56 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:04.499255 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-589456e6-f376-444e-8b62-d7173bd6fe56 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:04.501042 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-589456e6-f376-444e-8b62-d7173bd6fe56 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:04.501749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-589456e6-f376-444e-8b62-d7173bd6fe56 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:04.893277 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-589456e6-f376-444e-8b62-d7173bd6fe56 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:04.907621 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-589456e6-f376-444e-8b62-d7173bd6fe56 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1317 microversion: 2.1 time: 0.440228 Feb 17 03:28:04.919564 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 37/85] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:04 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:04.926039 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3d59643d-86ff-4b90-b1a8-94bc51c9221d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:04.927031 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3d59643d-86ff-4b90-b1a8-94bc51c9221d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:04.938173 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3d59643d-86ff-4b90-b1a8-94bc51c9221d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:04.939810 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3d59643d-86ff-4b90-b1a8-94bc51c9221d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:04.941234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3d59643d-86ff-4b90-b1a8-94bc51c9221d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:04.941931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3d59643d-86ff-4b90-b1a8-94bc51c9221d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:05.085686 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3d59643d-86ff-4b90-b1a8-94bc51c9221d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:05.089010 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-62352fcb-b27a-43b4-b332-0cdc2c59fdc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Flavor limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:28:05.089736 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-62352fcb-b27a-43b4-b332-0cdc2c59fdc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Image limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:28:05.091095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-62352fcb-b27a-43b4-b332-0cdc2c59fdc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Flavor pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:28:05.091760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-62352fcb-b27a-43b4-b332-0cdc2c59fdc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Image pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:28:05.092719 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-62352fcb-b27a-43b4-b332-0cdc2c59fdc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:28:05.095639 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3d59643d-86ff-4b90-b1a8-94bc51c9221d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:05.097262 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3d59643d-86ff-4b90-b1a8-94bc51c9221d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:05.098392 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3d59643d-86ff-4b90-b1a8-94bc51c9221d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1284 microversion: 2.20 time: 0.177335 Feb 17 03:28:05.099048 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 38/86] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:04 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:05.104354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a1331dc3-0f03-49ac-abf0-527ece918ea7 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:05.105017 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a1331dc3-0f03-49ac-abf0-527ece918ea7 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:05.112713 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1331dc3-0f03-49ac-abf0-527ece918ea7 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:05.113227 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1331dc3-0f03-49ac-abf0-527ece918ea7 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:05.114205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1331dc3-0f03-49ac-abf0-527ece918ea7 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:05.114834 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1331dc3-0f03-49ac-abf0-527ece918ea7 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:05.117864 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-62352fcb-b27a-43b4-b332-0cdc2c59fdc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:05.118568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-62352fcb-b27a-43b4-b332-0cdc2c59fdc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:05.119712 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-62352fcb-b27a-43b4-b332-0cdc2c59fdc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:05.120877 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-62352fcb-b27a-43b4-b332-0cdc2c59fdc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:05.154220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-62352fcb-b27a-43b4-b332-0cdc2c59fdc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Getting quotas for project c568344bec0146c19c14571bff20a759. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:28:05.158735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-62352fcb-b27a-43b4-b332-0cdc2c59fdc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Getting quotas for user f60e8201ff554fefa20487ac8f981d07 and project c568344bec0146c19c14571bff20a759. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:28:05.173527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-62352fcb-b27a-43b4-b332-0cdc2c59fdc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Going to run 1 instances... {{(pid=98104) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:28:05.176896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-62352fcb-b27a-43b4-b332-0cdc2c59fdc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27891a64-31b3-4754-87b4-bf609a12c59a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:28:05.252573 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-62352fcb-b27a-43b4-b332-0cdc2c59fdc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.759713 Feb 17 03:28:05.253631 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 49/87] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:28:03 2021] POST /compute/v2.1/servers => generated 401 bytes in 1761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:28:05.268784 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8f0d2c31-b1d2-4449-a7d5-037dd49b906e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:05.272353 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8f0d2c31-b1d2-4449-a7d5-037dd49b906e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:05.387992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8f0d2c31-b1d2-4449-a7d5-037dd49b906e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:05.397602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8f0d2c31-b1d2-4449-a7d5-037dd49b906e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1238 microversion: 2.1 time: 0.132916 Feb 17 03:28:05.398424 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 50/88] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:05 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1238 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:05.404094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a1331dc3-0f03-49ac-abf0-527ece918ea7 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:05.424363 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a1331dc3-0f03-49ac-abf0-527ece918ea7 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1499 microversion: 2.1 time: 0.324002 Feb 17 03:28:05.429080 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 39/89] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:05 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1499 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:05.482932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8a299a27-0b48-466e-b4b6-84e75640af1d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:05.483894 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8a299a27-0b48-466e-b4b6-84e75640af1d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:05.492931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a299a27-0b48-466e-b4b6-84e75640af1d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:05.493788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a299a27-0b48-466e-b4b6-84e75640af1d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:05.495320 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a299a27-0b48-466e-b4b6-84e75640af1d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:05.495948 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a299a27-0b48-466e-b4b6-84e75640af1d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:05.779004 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8a299a27-0b48-466e-b4b6-84e75640af1d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:05.792149 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8a299a27-0b48-466e-b4b6-84e75640af1d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.314572 Feb 17 03:28:05.794432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 51/90] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:05 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:05.928982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-090a7b34-8b94-4715-a2c9-abb09497029e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:05.930641 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-090a7b34-8b94-4715-a2c9-abb09497029e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:05.940772 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-090a7b34-8b94-4715-a2c9-abb09497029e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:05.941526 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-090a7b34-8b94-4715-a2c9-abb09497029e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:05.943200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-090a7b34-8b94-4715-a2c9-abb09497029e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:05.944103 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-090a7b34-8b94-4715-a2c9-abb09497029e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:06.118320 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-07400b21-6477-47f2-9408-da39b454fda5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:06.119188 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-07400b21-6477-47f2-9408-da39b454fda5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:06.135981 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07400b21-6477-47f2-9408-da39b454fda5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:06.136642 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07400b21-6477-47f2-9408-da39b454fda5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:06.138000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07400b21-6477-47f2-9408-da39b454fda5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:06.139286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07400b21-6477-47f2-9408-da39b454fda5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:06.191773 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-090a7b34-8b94-4715-a2c9-abb09497029e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:06.201494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-090a7b34-8b94-4715-a2c9-abb09497029e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1317 microversion: 2.1 time: 0.279303 Feb 17 03:28:06.211730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 40/91] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:05 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:06.285131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-07400b21-6477-47f2-9408-da39b454fda5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:06.295179 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-07400b21-6477-47f2-9408-da39b454fda5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:06.297209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-07400b21-6477-47f2-9408-da39b454fda5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:06.298775 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-07400b21-6477-47f2-9408-da39b454fda5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1276 microversion: 2.20 time: 0.184301 Feb 17 03:28:06.311760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 52/92] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:06 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:06.427942 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-513d2129-7f03-453c-b3dd-1fd42d226a6d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:06.428659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-513d2129-7f03-453c-b3dd-1fd42d226a6d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:06.437106 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-513d2129-7f03-453c-b3dd-1fd42d226a6d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:06.437575 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-513d2129-7f03-453c-b3dd-1fd42d226a6d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:06.438451 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-513d2129-7f03-453c-b3dd-1fd42d226a6d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:06.438936 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-513d2129-7f03-453c-b3dd-1fd42d226a6d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:06.596980 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-513d2129-7f03-453c-b3dd-1fd42d226a6d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:06.614301 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-513d2129-7f03-453c-b3dd-1fd42d226a6d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1242 microversion: 2.1 time: 0.190530 Feb 17 03:28:06.615141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 41/93] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:06 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1242 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:06.812296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e2d15909-74a1-48a8-a358-6ce911ccc38a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:06.813142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e2d15909-74a1-48a8-a358-6ce911ccc38a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:06.822403 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2d15909-74a1-48a8-a358-6ce911ccc38a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:06.822984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2d15909-74a1-48a8-a358-6ce911ccc38a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:06.823920 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2d15909-74a1-48a8-a358-6ce911ccc38a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:06.824550 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2d15909-74a1-48a8-a358-6ce911ccc38a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:07.061466 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e2d15909-74a1-48a8-a358-6ce911ccc38a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:07.072110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e2d15909-74a1-48a8-a358-6ce911ccc38a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.263969 Feb 17 03:28:07.072984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 53/94] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:06 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:07.224887 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2c3c6dff-91d6-47c2-acdb-9846a9a2596f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:07.225906 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2c3c6dff-91d6-47c2-acdb-9846a9a2596f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:07.234356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2c3c6dff-91d6-47c2-acdb-9846a9a2596f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:07.234866 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2c3c6dff-91d6-47c2-acdb-9846a9a2596f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:07.235880 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2c3c6dff-91d6-47c2-acdb-9846a9a2596f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:07.236563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2c3c6dff-91d6-47c2-acdb-9846a9a2596f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:07.319367 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4abb1732-51ef-45e3-afe0-60a895dd8bf8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:07.320658 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4abb1732-51ef-45e3-afe0-60a895dd8bf8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:07.329414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4abb1732-51ef-45e3-afe0-60a895dd8bf8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:07.329917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4abb1732-51ef-45e3-afe0-60a895dd8bf8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:07.330755 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4abb1732-51ef-45e3-afe0-60a895dd8bf8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:07.331401 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4abb1732-51ef-45e3-afe0-60a895dd8bf8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:07.516905 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4abb1732-51ef-45e3-afe0-60a895dd8bf8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:07.526958 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4abb1732-51ef-45e3-afe0-60a895dd8bf8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:07.528843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4abb1732-51ef-45e3-afe0-60a895dd8bf8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:07.529644 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4abb1732-51ef-45e3-afe0-60a895dd8bf8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1276 microversion: 2.20 time: 0.214646 Feb 17 03:28:07.530400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 54/95] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:07 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1276 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:28:07.539510 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2c3c6dff-91d6-47c2-acdb-9846a9a2596f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:07.548651 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2c3c6dff-91d6-47c2-acdb-9846a9a2596f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1317 microversion: 2.1 time: 0.332415 Feb 17 03:28:07.549257 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 42/96] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:07 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:07.632837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-589683cc-445e-41cb-a216-07186ad6055b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:07.633526 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-589683cc-445e-41cb-a216-07186ad6055b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:07.641922 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-589683cc-445e-41cb-a216-07186ad6055b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:07.642423 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-589683cc-445e-41cb-a216-07186ad6055b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:07.643245 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-589683cc-445e-41cb-a216-07186ad6055b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:07.643735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-589683cc-445e-41cb-a216-07186ad6055b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:07.782917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-589683cc-445e-41cb-a216-07186ad6055b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:07.792282 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-589683cc-445e-41cb-a216-07186ad6055b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1242 microversion: 2.1 time: 0.163418 Feb 17 03:28:07.793019 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 55/97] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:07 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1242 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:08.090684 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-169ce531-1cd2-4c97-a369-9efdf49febba tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:08.091350 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-169ce531-1cd2-4c97-a369-9efdf49febba tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:08.099268 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-169ce531-1cd2-4c97-a369-9efdf49febba tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:08.099771 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-169ce531-1cd2-4c97-a369-9efdf49febba tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:08.100587 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-169ce531-1cd2-4c97-a369-9efdf49febba tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:08.101090 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-169ce531-1cd2-4c97-a369-9efdf49febba tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:08.308137 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-169ce531-1cd2-4c97-a369-9efdf49febba tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:08.317158 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-169ce531-1cd2-4c97-a369-9efdf49febba tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.230497 Feb 17 03:28:08.317737 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 43/98] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:08 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:08.548220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c164d6fa-7ef0-4bb3-b2f2-6bd05df96cf3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:08.548888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c164d6fa-7ef0-4bb3-b2f2-6bd05df96cf3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:08.556836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c164d6fa-7ef0-4bb3-b2f2-6bd05df96cf3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:08.557343 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c164d6fa-7ef0-4bb3-b2f2-6bd05df96cf3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:08.558172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c164d6fa-7ef0-4bb3-b2f2-6bd05df96cf3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:08.558657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c164d6fa-7ef0-4bb3-b2f2-6bd05df96cf3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:08.566376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-028ea140-84e4-4516-84eb-99821a6f64e4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:08.567260 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-028ea140-84e4-4516-84eb-99821a6f64e4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:08.575676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-028ea140-84e4-4516-84eb-99821a6f64e4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:08.576284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-028ea140-84e4-4516-84eb-99821a6f64e4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:08.577269 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-028ea140-84e4-4516-84eb-99821a6f64e4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:08.577877 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-028ea140-84e4-4516-84eb-99821a6f64e4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:08.696852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c164d6fa-7ef0-4bb3-b2f2-6bd05df96cf3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:08.711558 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c164d6fa-7ef0-4bb3-b2f2-6bd05df96cf3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:08.715602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c164d6fa-7ef0-4bb3-b2f2-6bd05df96cf3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:08.718889 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c164d6fa-7ef0-4bb3-b2f2-6bd05df96cf3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1276 microversion: 2.20 time: 0.174410 Feb 17 03:28:08.727389 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 56/99] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:08 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1276 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:08.800108 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-028ea140-84e4-4516-84eb-99821a6f64e4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:08.808848 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-028ea140-84e4-4516-84eb-99821a6f64e4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1317 microversion: 2.1 time: 0.246485 Feb 17 03:28:08.809463 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 44/100] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:08 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:08.810830 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8d152074-6d7e-42de-be85-9f4d75148771 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:08.811493 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8d152074-6d7e-42de-be85-9f4d75148771 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:08.819704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8d152074-6d7e-42de-be85-9f4d75148771 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:08.820587 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8d152074-6d7e-42de-be85-9f4d75148771 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:08.821820 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8d152074-6d7e-42de-be85-9f4d75148771 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:08.822327 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8d152074-6d7e-42de-be85-9f4d75148771 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:08.948107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8d152074-6d7e-42de-be85-9f4d75148771 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:08.956765 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8d152074-6d7e-42de-be85-9f4d75148771 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1242 microversion: 2.1 time: 0.150012 Feb 17 03:28:08.957395 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 57/101] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:08 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1242 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:09.334994 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8f93293c-654a-41f0-9b80-6d8443d216e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:09.335663 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8f93293c-654a-41f0-9b80-6d8443d216e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:09.344225 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f93293c-654a-41f0-9b80-6d8443d216e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:09.344742 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f93293c-654a-41f0-9b80-6d8443d216e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:09.345619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f93293c-654a-41f0-9b80-6d8443d216e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:09.346113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f93293c-654a-41f0-9b80-6d8443d216e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:09.575391 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8f93293c-654a-41f0-9b80-6d8443d216e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:09.584356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8f93293c-654a-41f0-9b80-6d8443d216e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.253183 Feb 17 03:28:09.585551 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 45/102] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:09 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:09.606256 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-c059c6a3-4bba-48d0-b8df-f5e5cef7341b req-d82bc29c-020e-4b95-8503-bc1dd27a78d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d58358-22a0-4562-9370-9574a29ec572", "name": "network-vif-plugged", "status": "completed", "tag": "d5ada634-5cb7-40f0-b70e-0091b83e2ef6"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:09.608361 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:09.608361 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:28:09.649003 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-c059c6a3-4bba-48d0-b8df-f5e5cef7341b req-d82bc29c-020e-4b95-8503-bc1dd27a78d2 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:09.649523 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-c059c6a3-4bba-48d0-b8df-f5e5cef7341b req-d82bc29c-020e-4b95-8503-bc1dd27a78d2 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:09.688653 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-c059c6a3-4bba-48d0-b8df-f5e5cef7341b req-d82bc29c-020e-4b95-8503-bc1dd27a78d2 service nova] Creating event network-vif-plugged:d5ada634-5cb7-40f0-b70e-0091b83e2ef6 for instance b4d58358-22a0-4562-9370-9574a29ec572 on hv-cinder-75994 Feb 17 03:28:09.707119 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-c059c6a3-4bba-48d0-b8df-f5e5cef7341b req-d82bc29c-020e-4b95-8503-bc1dd27a78d2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105420 Feb 17 03:28:09.707778 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 58/103] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:09.753043 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bcee60a5-8c32-40cb-bdca-5caccd40936f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:09.753723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bcee60a5-8c32-40cb-bdca-5caccd40936f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:09.768518 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bcee60a5-8c32-40cb-bdca-5caccd40936f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:09.769021 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bcee60a5-8c32-40cb-bdca-5caccd40936f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:09.772032 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bcee60a5-8c32-40cb-bdca-5caccd40936f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:09.777754 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bcee60a5-8c32-40cb-bdca-5caccd40936f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:09.830454 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c0973906-ecfa-47ae-b8ee-0bdb78ee9aa1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:09.832105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c0973906-ecfa-47ae-b8ee-0bdb78ee9aa1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:09.847291 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c0973906-ecfa-47ae-b8ee-0bdb78ee9aa1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:09.848032 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c0973906-ecfa-47ae-b8ee-0bdb78ee9aa1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:09.849071 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c0973906-ecfa-47ae-b8ee-0bdb78ee9aa1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:09.855383 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c0973906-ecfa-47ae-b8ee-0bdb78ee9aa1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:09.981372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bcee60a5-8c32-40cb-bdca-5caccd40936f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:09.992079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bcee60a5-8c32-40cb-bdca-5caccd40936f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:09.993719 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bcee60a5-8c32-40cb-bdca-5caccd40936f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:09.995489 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bcee60a5-8c32-40cb-bdca-5caccd40936f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1350 microversion: 2.20 time: 0.252307 Feb 17 03:28:09.996382 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 46/104] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:09 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1350 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:10.001617 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8374f7eb-b621-49ef-8705-df4e6df777ea tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:10.002314 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8374f7eb-b621-49ef-8705-df4e6df777ea tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:10.010176 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8374f7eb-b621-49ef-8705-df4e6df777ea tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:10.010931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8374f7eb-b621-49ef-8705-df4e6df777ea tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:10.011779 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8374f7eb-b621-49ef-8705-df4e6df777ea tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:10.012274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8374f7eb-b621-49ef-8705-df4e6df777ea tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:10.170298 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8374f7eb-b621-49ef-8705-df4e6df777ea tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:10.180837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8374f7eb-b621-49ef-8705-df4e6df777ea tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1290 microversion: 2.1 time: 0.182919 Feb 17 03:28:10.182101 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 47/105] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:09 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1290 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:10.337798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c0973906-ecfa-47ae-b8ee-0bdb78ee9aa1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:10.346996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c0973906-ecfa-47ae-b8ee-0bdb78ee9aa1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1507 microversion: 2.1 time: 0.520943 Feb 17 03:28:10.347958 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 59/106] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:09 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1507 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:10.603701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6e8e8f6b-a113-4beb-b140-d597a6933dc1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:10.604461 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6e8e8f6b-a113-4beb-b140-d597a6933dc1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:10.616709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e8e8f6b-a113-4beb-b140-d597a6933dc1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:10.617243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e8e8f6b-a113-4beb-b140-d597a6933dc1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:10.618108 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e8e8f6b-a113-4beb-b140-d597a6933dc1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:10.618581 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e8e8f6b-a113-4beb-b140-d597a6933dc1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:10.885840 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fa8da357-4627-4827-926b-51a59c59d9a5 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce99cc54-2768-4a1a-bb4d-39e7b48b4ebb"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:10.887158 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fa8da357-4627-4827-926b-51a59c59d9a5 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:10.924682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fa8da357-4627-4827-926b-51a59c59d9a5 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:10.925495 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fa8da357-4627-4827-926b-51a59c59d9a5 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:10.926514 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fa8da357-4627-4827-926b-51a59c59d9a5 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:10.927148 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fa8da357-4627-4827-926b-51a59c59d9a5 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:11.051935 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6e8e8f6b-a113-4beb-b140-d597a6933dc1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:11.070461 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6e8e8f6b-a113-4beb-b140-d597a6933dc1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.471917 Feb 17 03:28:11.071226 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 48/107] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:10 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:11.076778 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d0ad4430-6562-40c3-ab32-fa1da76a7db5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:11.077723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d0ad4430-6562-40c3-ab32-fa1da76a7db5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:11.085776 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d0ad4430-6562-40c3-ab32-fa1da76a7db5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:11.086377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d0ad4430-6562-40c3-ab32-fa1da76a7db5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:11.087442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d0ad4430-6562-40c3-ab32-fa1da76a7db5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:11.088164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d0ad4430-6562-40c3-ab32-fa1da76a7db5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:11.240332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d0ad4430-6562-40c3-ab32-fa1da76a7db5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:11.250478 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d0ad4430-6562-40c3-ab32-fa1da76a7db5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:11.252058 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d0ad4430-6562-40c3-ab32-fa1da76a7db5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:11.253218 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d0ad4430-6562-40c3-ab32-fa1da76a7db5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1338 microversion: 2.20 time: 0.181146 Feb 17 03:28:11.254177 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 49/108] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:11 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1338 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:11.269409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8b10eaba-6267-4f04-9ed8-be868033523c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:11.270087 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8b10eaba-6267-4f04-9ed8-be868033523c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:11.280495 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8b10eaba-6267-4f04-9ed8-be868033523c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:11.281005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8b10eaba-6267-4f04-9ed8-be868033523c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:11.282286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8b10eaba-6267-4f04-9ed8-be868033523c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:11.282775 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8b10eaba-6267-4f04-9ed8-be868033523c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:11.617422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fa8da357-4627-4827-926b-51a59c59d9a5 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "POST /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.732317 Feb 17 03:28:11.624040 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 60/109] 10.222.0.57 () {60 vars in 1313 bytes} [Wed Feb 17 03:28:10 2021] POST /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51/os-volume_attachments => generated 194 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:11.624411 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8b10eaba-6267-4f04-9ed8-be868033523c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:11.649692 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8b10eaba-6267-4f04-9ed8-be868033523c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1298 microversion: 2.1 time: 0.394587 Feb 17 03:28:11.650845 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 50/110] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:11 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1298 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:12.090643 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-83de141b-0aed-4bbc-bbed-9f388aa45db0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:12.091651 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-83de141b-0aed-4bbc-bbed-9f388aa45db0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:12.099723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-83de141b-0aed-4bbc-bbed-9f388aa45db0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:12.100346 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-83de141b-0aed-4bbc-bbed-9f388aa45db0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:12.101352 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-83de141b-0aed-4bbc-bbed-9f388aa45db0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:12.101950 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-83de141b-0aed-4bbc-bbed-9f388aa45db0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:12.272223 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6223b78b-6c58-4900-afe9-9614ef616bc2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:12.272960 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6223b78b-6c58-4900-afe9-9614ef616bc2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:12.281229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6223b78b-6c58-4900-afe9-9614ef616bc2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:12.281818 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6223b78b-6c58-4900-afe9-9614ef616bc2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:12.282733 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6223b78b-6c58-4900-afe9-9614ef616bc2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:12.283295 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6223b78b-6c58-4900-afe9-9614ef616bc2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:12.326657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-83de141b-0aed-4bbc-bbed-9f388aa45db0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:12.335672 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-83de141b-0aed-4bbc-bbed-9f388aa45db0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.250321 Feb 17 03:28:12.336247 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 61/111] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:12 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:12.501013 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6223b78b-6c58-4900-afe9-9614ef616bc2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:12.511056 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6223b78b-6c58-4900-afe9-9614ef616bc2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:12.512636 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6223b78b-6c58-4900-afe9-9614ef616bc2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:12.513849 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6223b78b-6c58-4900-afe9-9614ef616bc2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.246022 Feb 17 03:28:12.514418 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 51/112] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:12 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:28:12.668870 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e82ceb96-c84c-44fe-b10b-6a1b1a663585 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:12.669582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e82ceb96-c84c-44fe-b10b-6a1b1a663585 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:12.677916 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e82ceb96-c84c-44fe-b10b-6a1b1a663585 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:12.678561 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e82ceb96-c84c-44fe-b10b-6a1b1a663585 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:12.679265 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e82ceb96-c84c-44fe-b10b-6a1b1a663585 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:12.679749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e82ceb96-c84c-44fe-b10b-6a1b1a663585 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:12.807128 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e82ceb96-c84c-44fe-b10b-6a1b1a663585 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:12.816751 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e82ceb96-c84c-44fe-b10b-6a1b1a663585 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1296 microversion: 2.1 time: 0.152603 Feb 17 03:28:12.817650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 62/113] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:12 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1296 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:13.354233 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-65463952-efdc-475f-8d08-c62def16495f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:13.354899 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-65463952-efdc-475f-8d08-c62def16495f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:13.362834 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-65463952-efdc-475f-8d08-c62def16495f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:13.363341 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-65463952-efdc-475f-8d08-c62def16495f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:13.364182 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-65463952-efdc-475f-8d08-c62def16495f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:13.364673 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-65463952-efdc-475f-8d08-c62def16495f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:13.532662 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8125b961-cb1f-415b-a208-98db9a3f768b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:13.533399 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8125b961-cb1f-415b-a208-98db9a3f768b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:13.543891 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8125b961-cb1f-415b-a208-98db9a3f768b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:13.544236 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8125b961-cb1f-415b-a208-98db9a3f768b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:13.545103 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8125b961-cb1f-415b-a208-98db9a3f768b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:13.545563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8125b961-cb1f-415b-a208-98db9a3f768b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:13.572425 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-65463952-efdc-475f-8d08-c62def16495f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:13.581508 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-65463952-efdc-475f-8d08-c62def16495f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.231848 Feb 17 03:28:13.582111 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 52/114] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:13 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:13.775617 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8125b961-cb1f-415b-a208-98db9a3f768b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:13.785105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8125b961-cb1f-415b-a208-98db9a3f768b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:13.786740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8125b961-cb1f-415b-a208-98db9a3f768b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:13.787868 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8125b961-cb1f-415b-a208-98db9a3f768b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.259251 Feb 17 03:28:13.788652 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 63/115] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:13 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:13.836283 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fa93e2f0-f6c9-4888-aee8-a4920e550ed5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:13.836866 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fa93e2f0-f6c9-4888-aee8-a4920e550ed5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:13.844676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fa93e2f0-f6c9-4888-aee8-a4920e550ed5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:13.845339 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fa93e2f0-f6c9-4888-aee8-a4920e550ed5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:13.846179 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fa93e2f0-f6c9-4888-aee8-a4920e550ed5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:13.846670 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fa93e2f0-f6c9-4888-aee8-a4920e550ed5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:13.980322 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-fa93e2f0-f6c9-4888-aee8-a4920e550ed5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:13.990445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fa93e2f0-f6c9-4888-aee8-a4920e550ed5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1296 microversion: 2.1 time: 0.158325 Feb 17 03:28:13.999660 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 53/116] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:13 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1296 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:14.600070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b99504fc-6e2f-42e3-b490-1d52a19a5364 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:14.600664 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b99504fc-6e2f-42e3-b490-1d52a19a5364 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:14.608821 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b99504fc-6e2f-42e3-b490-1d52a19a5364 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:14.609342 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b99504fc-6e2f-42e3-b490-1d52a19a5364 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:14.610163 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b99504fc-6e2f-42e3-b490-1d52a19a5364 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:14.610642 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b99504fc-6e2f-42e3-b490-1d52a19a5364 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:14.806947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f4867b5a-9365-4498-9ea9-8964b30b557f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:14.807609 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f4867b5a-9365-4498-9ea9-8964b30b557f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:14.815366 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4867b5a-9365-4498-9ea9-8964b30b557f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:14.815874 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4867b5a-9365-4498-9ea9-8964b30b557f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:14.816711 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4867b5a-9365-4498-9ea9-8964b30b557f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:14.817288 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4867b5a-9365-4498-9ea9-8964b30b557f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:14.817846 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b99504fc-6e2f-42e3-b490-1d52a19a5364 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:14.828024 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b99504fc-6e2f-42e3-b490-1d52a19a5364 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.231942 Feb 17 03:28:14.828710 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 64/117] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:14 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:15.008173 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-828b7808-d3ab-4bb3-9676-09e8417947ce tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:15.008829 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-828b7808-d3ab-4bb3-9676-09e8417947ce tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:15.017019 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-828b7808-d3ab-4bb3-9676-09e8417947ce tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:15.017548 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-828b7808-d3ab-4bb3-9676-09e8417947ce tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:15.018369 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-828b7808-d3ab-4bb3-9676-09e8417947ce tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:15.018850 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-828b7808-d3ab-4bb3-9676-09e8417947ce tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:15.024551 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f4867b5a-9365-4498-9ea9-8964b30b557f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:15.034505 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f4867b5a-9365-4498-9ea9-8964b30b557f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:15.036075 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f4867b5a-9365-4498-9ea9-8964b30b557f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:15.037229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f4867b5a-9365-4498-9ea9-8964b30b557f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.234293 Feb 17 03:28:15.037807 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 54/118] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:14 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:15.146489 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-828b7808-d3ab-4bb3-9676-09e8417947ce tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:15.155952 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-828b7808-d3ab-4bb3-9676-09e8417947ce tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1296 microversion: 2.1 time: 0.151985 Feb 17 03:28:15.156527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 65/119] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:15 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1296 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:15.846739 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-478db452-d016-4317-ad58-225533e938c6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:15.847307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-478db452-d016-4317-ad58-225533e938c6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:15.855314 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-478db452-d016-4317-ad58-225533e938c6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:15.855820 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-478db452-d016-4317-ad58-225533e938c6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:15.856657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-478db452-d016-4317-ad58-225533e938c6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:15.857167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-478db452-d016-4317-ad58-225533e938c6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:16.057142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-90c4b383-ecb1-4e92-9708-db05f80bc67d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:16.058093 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-90c4b383-ecb1-4e92-9708-db05f80bc67d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:16.067238 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90c4b383-ecb1-4e92-9708-db05f80bc67d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:16.067973 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90c4b383-ecb1-4e92-9708-db05f80bc67d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:16.069413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90c4b383-ecb1-4e92-9708-db05f80bc67d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:16.070339 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90c4b383-ecb1-4e92-9708-db05f80bc67d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:16.163571 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-478db452-d016-4317-ad58-225533e938c6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:16.172885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-478db452-d016-4317-ad58-225533e938c6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.330208 Feb 17 03:28:16.173506 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 55/120] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:15 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:16.182508 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-50f6418e-f4d2-4afa-966f-fbc171618bf1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:16.184864 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-50f6418e-f4d2-4afa-966f-fbc171618bf1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:16.198644 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-50f6418e-f4d2-4afa-966f-fbc171618bf1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:16.199479 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-50f6418e-f4d2-4afa-966f-fbc171618bf1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:16.200464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-50f6418e-f4d2-4afa-966f-fbc171618bf1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:16.201131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-50f6418e-f4d2-4afa-966f-fbc171618bf1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:16.371176 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-50f6418e-f4d2-4afa-966f-fbc171618bf1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:16.381061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-50f6418e-f4d2-4afa-966f-fbc171618bf1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1296 microversion: 2.1 time: 0.206211 Feb 17 03:28:16.381894 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 56/121] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:16 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1296 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:16.579823 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-90c4b383-ecb1-4e92-9708-db05f80bc67d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:16.589332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-90c4b383-ecb1-4e92-9708-db05f80bc67d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:16.590921 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-90c4b383-ecb1-4e92-9708-db05f80bc67d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:16.592047 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-90c4b383-ecb1-4e92-9708-db05f80bc67d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.540009 Feb 17 03:28:16.593166 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 66/122] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:16 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:17.196535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-54e67853-c9c3-4ed2-8be6-cb3572fc4178 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:17.198432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-54e67853-c9c3-4ed2-8be6-cb3572fc4178 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:17.214340 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54e67853-c9c3-4ed2-8be6-cb3572fc4178 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:17.222676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54e67853-c9c3-4ed2-8be6-cb3572fc4178 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:17.223987 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54e67853-c9c3-4ed2-8be6-cb3572fc4178 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:17.224715 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54e67853-c9c3-4ed2-8be6-cb3572fc4178 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:17.399133 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-578c37d7-79ee-4219-972a-0a4849185d16 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:17.401142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-578c37d7-79ee-4219-972a-0a4849185d16 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:17.421381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-578c37d7-79ee-4219-972a-0a4849185d16 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:17.422204 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-578c37d7-79ee-4219-972a-0a4849185d16 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:17.423335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-578c37d7-79ee-4219-972a-0a4849185d16 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:17.424035 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-578c37d7-79ee-4219-972a-0a4849185d16 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:17.836372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-578c37d7-79ee-4219-972a-0a4849185d16 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:17.858971 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-54e67853-c9c3-4ed2-8be6-cb3572fc4178 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:17.870889 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-54e67853-c9c3-4ed2-8be6-cb3572fc4178 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.682801 Feb 17 03:28:17.885839 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-578c37d7-79ee-4219-972a-0a4849185d16 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.478108 Feb 17 03:28:17.885839 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 67/123] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:17 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:17.885839 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ea4f7a25-db6f-4111-ae6e-39f9567a1b20 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:17.885839 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ea4f7a25-db6f-4111-ae6e-39f9567a1b20 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:17.887634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 57/124] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:17 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:17.910473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea4f7a25-db6f-4111-ae6e-39f9567a1b20 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:17.910981 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea4f7a25-db6f-4111-ae6e-39f9567a1b20 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:17.911844 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea4f7a25-db6f-4111-ae6e-39f9567a1b20 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:17.912335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea4f7a25-db6f-4111-ae6e-39f9567a1b20 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:18.144619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-44ebf9a7-6590-4862-8c5e-80efb7d150c7 req-1cd55014-6c8c-4201-b665-b31fe0a9db99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4840bec6-59fa-4a75-9cab-b8eba3fced9d", "tag": "3122eba0-b4d4-415e-b7c0-f67223c6ab3f"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:18.147999 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:18.147999 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:28:18.158667 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-44ebf9a7-6590-4862-8c5e-80efb7d150c7 req-1cd55014-6c8c-4201-b665-b31fe0a9db99 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:18.159334 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-44ebf9a7-6590-4862-8c5e-80efb7d150c7 req-1cd55014-6c8c-4201-b665-b31fe0a9db99 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:18.178884 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-44ebf9a7-6590-4862-8c5e-80efb7d150c7 req-1cd55014-6c8c-4201-b665-b31fe0a9db99 service nova] Creating event network-changed:3122eba0-b4d4-415e-b7c0-f67223c6ab3f for instance 4840bec6-59fa-4a75-9cab-b8eba3fced9d on hv-cinder-75994 Feb 17 03:28:18.185788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-44ebf9a7-6590-4862-8c5e-80efb7d150c7 req-1cd55014-6c8c-4201-b665-b31fe0a9db99 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045938 Feb 17 03:28:18.186829 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 58/125] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:28:18.214313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ea4f7a25-db6f-4111-ae6e-39f9567a1b20 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:18.224227 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ea4f7a25-db6f-4111-ae6e-39f9567a1b20 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:18.225925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ea4f7a25-db6f-4111-ae6e-39f9567a1b20 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:18.227059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ea4f7a25-db6f-4111-ae6e-39f9567a1b20 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.347545 Feb 17 03:28:18.227839 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 68/126] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:17 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:18.901516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fb837d19-78fd-4c06-b57f-54097140a03a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:18.902629 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fb837d19-78fd-4c06-b57f-54097140a03a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:18.902756 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-44c59f84-f442-4288-a0a7-21c544f634d4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:18.903398 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-44c59f84-f442-4288-a0a7-21c544f634d4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:18.911590 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fb837d19-78fd-4c06-b57f-54097140a03a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:18.912126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fb837d19-78fd-4c06-b57f-54097140a03a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:18.912430 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-44c59f84-f442-4288-a0a7-21c544f634d4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:18.912941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-44c59f84-f442-4288-a0a7-21c544f634d4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:18.913301 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fb837d19-78fd-4c06-b57f-54097140a03a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:18.913790 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fb837d19-78fd-4c06-b57f-54097140a03a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:18.913888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-44c59f84-f442-4288-a0a7-21c544f634d4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:18.914386 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-44c59f84-f442-4288-a0a7-21c544f634d4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:19.151174 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-fb837d19-78fd-4c06-b57f-54097140a03a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:19.152764 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-44c59f84-f442-4288-a0a7-21c544f634d4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:19.161363 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fb837d19-78fd-4c06-b57f-54097140a03a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.265146 Feb 17 03:28:19.162084 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 59/127] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:18 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:19.162201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-44c59f84-f442-4288-a0a7-21c544f634d4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.264447 Feb 17 03:28:19.162893 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 69/128] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:18 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:19.167339 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-2d9bd7cd-89d7-449d-a3ad-1c9f6526a2f1 req-edf33c26-2f18-4f09-80dc-2bb5f677cd0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c5a8ede-8248-460e-bef7-6b5c3aaf48f5", "tag": "48fb65e6-ad21-424b-ad45-8e4c51055da6"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:19.169222 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:19.169222 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:28:19.177940 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-2d9bd7cd-89d7-449d-a3ad-1c9f6526a2f1 req-edf33c26-2f18-4f09-80dc-2bb5f677cd0c service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:19.178504 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-2d9bd7cd-89d7-449d-a3ad-1c9f6526a2f1 req-edf33c26-2f18-4f09-80dc-2bb5f677cd0c service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:19.195921 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-2d9bd7cd-89d7-449d-a3ad-1c9f6526a2f1 req-edf33c26-2f18-4f09-80dc-2bb5f677cd0c service nova] Creating event network-changed:48fb65e6-ad21-424b-ad45-8e4c51055da6 for instance 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 on hv-cinder-75994 Feb 17 03:28:19.201402 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-2d9bd7cd-89d7-449d-a3ad-1c9f6526a2f1 req-edf33c26-2f18-4f09-80dc-2bb5f677cd0c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037866 Feb 17 03:28:19.202019 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 60/129] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:19.246882 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c1a0e222-df16-4cbc-8036-bb73cd92f543 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:19.247502 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c1a0e222-df16-4cbc-8036-bb73cd92f543 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:19.255221 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c1a0e222-df16-4cbc-8036-bb73cd92f543 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:19.255721 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c1a0e222-df16-4cbc-8036-bb73cd92f543 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:19.256550 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c1a0e222-df16-4cbc-8036-bb73cd92f543 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:19.257067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c1a0e222-df16-4cbc-8036-bb73cd92f543 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:19.465546 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c1a0e222-df16-4cbc-8036-bb73cd92f543 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:19.474700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c1a0e222-df16-4cbc-8036-bb73cd92f543 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:19.476272 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c1a0e222-df16-4cbc-8036-bb73cd92f543 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:19.477414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c1a0e222-df16-4cbc-8036-bb73cd92f543 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.234998 Feb 17 03:28:19.478500 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 70/130] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:19 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:20.179638 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0a28f3f5-1a8b-4d70-a230-cb135bc6fb36 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:20.180088 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6a55a014-32af-46ec-ab70-4ab58e8b2fe3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:20.180304 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0a28f3f5-1a8b-4d70-a230-cb135bc6fb36 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:20.180900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6a55a014-32af-46ec-ab70-4ab58e8b2fe3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:20.188070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a28f3f5-1a8b-4d70-a230-cb135bc6fb36 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:20.188566 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a28f3f5-1a8b-4d70-a230-cb135bc6fb36 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:20.188922 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6a55a014-32af-46ec-ab70-4ab58e8b2fe3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:20.189445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a28f3f5-1a8b-4d70-a230-cb135bc6fb36 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:20.189566 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6a55a014-32af-46ec-ab70-4ab58e8b2fe3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:20.189934 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a28f3f5-1a8b-4d70-a230-cb135bc6fb36 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:20.190372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6a55a014-32af-46ec-ab70-4ab58e8b2fe3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:20.190858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6a55a014-32af-46ec-ab70-4ab58e8b2fe3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:20.401288 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6a55a014-32af-46ec-ab70-4ab58e8b2fe3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:20.401892 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0a28f3f5-1a8b-4d70-a230-cb135bc6fb36 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:20.410063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6a55a014-32af-46ec-ab70-4ab58e8b2fe3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.234648 Feb 17 03:28:20.410530 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0a28f3f5-1a8b-4d70-a230-cb135bc6fb36 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.234832 Feb 17 03:28:20.410640 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 61/131] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:20 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:20.411118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 71/132] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:20 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:20.497055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-637439c4-7d6e-40cc-b181-fca10da274fe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:20.497705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-637439c4-7d6e-40cc-b181-fca10da274fe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:20.505376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-637439c4-7d6e-40cc-b181-fca10da274fe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:20.505876 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-637439c4-7d6e-40cc-b181-fca10da274fe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:20.506701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-637439c4-7d6e-40cc-b181-fca10da274fe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:20.507184 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-637439c4-7d6e-40cc-b181-fca10da274fe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:20.716687 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-637439c4-7d6e-40cc-b181-fca10da274fe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:20.726580 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-637439c4-7d6e-40cc-b181-fca10da274fe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:20.728158 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-637439c4-7d6e-40cc-b181-fca10da274fe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:20.729310 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-637439c4-7d6e-40cc-b181-fca10da274fe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.236644 Feb 17 03:28:20.729886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 62/133] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:20 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:21.427841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-da6c7452-2ff2-44cf-93aa-c055fa34c8ef tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:21.428308 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4c3890a1-d3d6-4f8c-a8a7-424ce2539d09 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:21.428450 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-da6c7452-2ff2-44cf-93aa-c055fa34c8ef tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:21.428609 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4c3890a1-d3d6-4f8c-a8a7-424ce2539d09 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:21.436298 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da6c7452-2ff2-44cf-93aa-c055fa34c8ef tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:21.436500 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c3890a1-d3d6-4f8c-a8a7-424ce2539d09 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:21.436804 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da6c7452-2ff2-44cf-93aa-c055fa34c8ef tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:21.437005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c3890a1-d3d6-4f8c-a8a7-424ce2539d09 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:21.437688 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da6c7452-2ff2-44cf-93aa-c055fa34c8ef tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:21.437871 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c3890a1-d3d6-4f8c-a8a7-424ce2539d09 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:21.438181 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da6c7452-2ff2-44cf-93aa-c055fa34c8ef tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:21.438406 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c3890a1-d3d6-4f8c-a8a7-424ce2539d09 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:21.649059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4c3890a1-d3d6-4f8c-a8a7-424ce2539d09 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:21.658455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4c3890a1-d3d6-4f8c-a8a7-424ce2539d09 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.234694 Feb 17 03:28:21.659051 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 72/134] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:21 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:21.661375 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-da6c7452-2ff2-44cf-93aa-c055fa34c8ef tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:21.670241 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-da6c7452-2ff2-44cf-93aa-c055fa34c8ef tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.246402 Feb 17 03:28:21.670811 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 63/135] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:21 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:21.748121 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-51bd89eb-370a-42fc-a126-bcaddca5564e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:21.748727 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-51bd89eb-370a-42fc-a126-bcaddca5564e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:21.756402 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-51bd89eb-370a-42fc-a126-bcaddca5564e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:21.756909 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-51bd89eb-370a-42fc-a126-bcaddca5564e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:21.757795 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-51bd89eb-370a-42fc-a126-bcaddca5564e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:21.758290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-51bd89eb-370a-42fc-a126-bcaddca5564e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:21.972699 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-51bd89eb-370a-42fc-a126-bcaddca5564e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:21.982121 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-51bd89eb-370a-42fc-a126-bcaddca5564e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:21.983559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-51bd89eb-370a-42fc-a126-bcaddca5564e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:21.984671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-51bd89eb-370a-42fc-a126-bcaddca5564e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.240567 Feb 17 03:28:21.985304 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 73/136] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:21 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:22.676281 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b77fd458-1e49-491b-90a4-ef619c939de0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:22.676946 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b77fd458-1e49-491b-90a4-ef619c939de0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:22.685704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b77fd458-1e49-491b-90a4-ef619c939de0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:22.686207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b77fd458-1e49-491b-90a4-ef619c939de0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:22.687033 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b77fd458-1e49-491b-90a4-ef619c939de0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:22.687516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b77fd458-1e49-491b-90a4-ef619c939de0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:22.688190 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-76b7b948-8f70-4e7b-a0d1-223a81473536 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:22.688855 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-76b7b948-8f70-4e7b-a0d1-223a81473536 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:22.697344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-76b7b948-8f70-4e7b-a0d1-223a81473536 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:22.697842 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-76b7b948-8f70-4e7b-a0d1-223a81473536 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:22.698676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-76b7b948-8f70-4e7b-a0d1-223a81473536 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:22.699160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-76b7b948-8f70-4e7b-a0d1-223a81473536 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:22.916568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-76b7b948-8f70-4e7b-a0d1-223a81473536 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:22.918411 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b77fd458-1e49-491b-90a4-ef619c939de0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:22.925487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-76b7b948-8f70-4e7b-a0d1-223a81473536 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.241185 Feb 17 03:28:22.926071 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 74/137] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:22 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:22.927361 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b77fd458-1e49-491b-90a4-ef619c939de0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.255128 Feb 17 03:28:22.928733 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 64/138] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:22 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:23.003911 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-efac7016-f9e1-4aaa-a1e6-1469ec224a87 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:23.004600 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-efac7016-f9e1-4aaa-a1e6-1469ec224a87 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:23.012239 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-efac7016-f9e1-4aaa-a1e6-1469ec224a87 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:23.012739 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-efac7016-f9e1-4aaa-a1e6-1469ec224a87 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:23.013619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-efac7016-f9e1-4aaa-a1e6-1469ec224a87 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:23.014103 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-efac7016-f9e1-4aaa-a1e6-1469ec224a87 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:23.235999 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-efac7016-f9e1-4aaa-a1e6-1469ec224a87 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:23.243609 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-efac7016-f9e1-4aaa-a1e6-1469ec224a87 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:23.245216 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-efac7016-f9e1-4aaa-a1e6-1469ec224a87 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:23.246347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-efac7016-f9e1-4aaa-a1e6-1469ec224a87 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.246457 Feb 17 03:28:23.246923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 75/139] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:22 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:28:23.947320 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-417caf7e-47ff-481e-b30e-d0af3a8fe143 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:23.947978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-417caf7e-47ff-481e-b30e-d0af3a8fe143 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:23.954645 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a921cdab-ec44-49cf-b054-2b991f269152 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:23.955563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a921cdab-ec44-49cf-b054-2b991f269152 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:23.957303 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-417caf7e-47ff-481e-b30e-d0af3a8fe143 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:23.957808 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-417caf7e-47ff-481e-b30e-d0af3a8fe143 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:23.958651 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-417caf7e-47ff-481e-b30e-d0af3a8fe143 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:23.959371 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-417caf7e-47ff-481e-b30e-d0af3a8fe143 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:23.963937 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a921cdab-ec44-49cf-b054-2b991f269152 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:23.964710 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a921cdab-ec44-49cf-b054-2b991f269152 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:23.965793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a921cdab-ec44-49cf-b054-2b991f269152 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:23.966459 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a921cdab-ec44-49cf-b054-2b991f269152 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:24.396399 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a921cdab-ec44-49cf-b054-2b991f269152 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:24.407329 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a921cdab-ec44-49cf-b054-2b991f269152 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.467240 Feb 17 03:28:24.409058 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 65/140] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:23 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:24.414347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bef82a6a-5ce3-4536-aa4c-817c46f47a74 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:24.415297 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bef82a6a-5ce3-4536-aa4c-817c46f47a74 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:24.424900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bef82a6a-5ce3-4536-aa4c-817c46f47a74 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:24.425672 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bef82a6a-5ce3-4536-aa4c-817c46f47a74 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:24.426732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bef82a6a-5ce3-4536-aa4c-817c46f47a74 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:24.428322 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bef82a6a-5ce3-4536-aa4c-817c46f47a74 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:24.798234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-417caf7e-47ff-481e-b30e-d0af3a8fe143 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:24.812541 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-417caf7e-47ff-481e-b30e-d0af3a8fe143 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.869925 Feb 17 03:28:24.813416 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 76/141] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:23 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:24.814645 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bef82a6a-5ce3-4536-aa4c-817c46f47a74 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:24.822973 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bbf3577f-678f-4ec6-9759-0b1eb376891f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce762e97-cdd5-4b56-ac58-8cc4601a0c47"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:24.825331 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bbf3577f-678f-4ec6-9759-0b1eb376891f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:24.829750 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bef82a6a-5ce3-4536-aa4c-817c46f47a74 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:24.833227 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bef82a6a-5ce3-4536-aa4c-817c46f47a74 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:24.834381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bef82a6a-5ce3-4536-aa4c-817c46f47a74 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.424013 Feb 17 03:28:24.836205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 66/142] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:24 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:24.847932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bbf3577f-678f-4ec6-9759-0b1eb376891f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:24.848451 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bbf3577f-678f-4ec6-9759-0b1eb376891f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:24.850154 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bbf3577f-678f-4ec6-9759-0b1eb376891f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:24.850816 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bbf3577f-678f-4ec6-9759-0b1eb376891f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:25.425396 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6e50df42-18a7-4024-b689-639c2bdfd761 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:25.426786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6e50df42-18a7-4024-b689-639c2bdfd761 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:25.436870 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e50df42-18a7-4024-b689-639c2bdfd761 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:25.437820 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e50df42-18a7-4024-b689-639c2bdfd761 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:25.438858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e50df42-18a7-4024-b689-639c2bdfd761 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:25.440456 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e50df42-18a7-4024-b689-639c2bdfd761 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:25.600787 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bbf3577f-678f-4ec6-9759-0b1eb376891f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "POST /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.785667 Feb 17 03:28:25.601632 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 77/143] 10.222.0.57 () {60 vars in 1313 bytes} [Wed Feb 17 03:28:24 2021] POST /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96/os-volume_attachments => generated 194 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:25.700188 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6e50df42-18a7-4024-b689-639c2bdfd761 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:25.710110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6e50df42-18a7-4024-b689-639c2bdfd761 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.288869 Feb 17 03:28:25.711074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 67/144] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:25 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:25.832250 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-30180da6-6b11-42bc-91a0-7abdf86ac82d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:25.833011 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-30180da6-6b11-42bc-91a0-7abdf86ac82d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:25.858856 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e0cd1516-a650-414d-a7ac-92c7592d5679 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:25.865744 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e0cd1516-a650-414d-a7ac-92c7592d5679 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:25.871207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30180da6-6b11-42bc-91a0-7abdf86ac82d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:25.871933 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30180da6-6b11-42bc-91a0-7abdf86ac82d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:25.873009 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30180da6-6b11-42bc-91a0-7abdf86ac82d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:25.873868 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30180da6-6b11-42bc-91a0-7abdf86ac82d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:25.887086 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e0cd1516-a650-414d-a7ac-92c7592d5679 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:25.887601 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e0cd1516-a650-414d-a7ac-92c7592d5679 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:25.888464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e0cd1516-a650-414d-a7ac-92c7592d5679 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:25.888956 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e0cd1516-a650-414d-a7ac-92c7592d5679 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:26.141739 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e0cd1516-a650-414d-a7ac-92c7592d5679 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:26.165807 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e0cd1516-a650-414d-a7ac-92c7592d5679 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:26.167783 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e0cd1516-a650-414d-a7ac-92c7592d5679 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:26.168970 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e0cd1516-a650-414d-a7ac-92c7592d5679 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.314706 Feb 17 03:28:26.169588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 68/145] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:25 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:26.208774 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-30180da6-6b11-42bc-91a0-7abdf86ac82d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:26.219636 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-30180da6-6b11-42bc-91a0-7abdf86ac82d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.392118 Feb 17 03:28:26.230255 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 78/146] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:25 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:26.607150 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-a521bf1e-a4b4-4722-9525-4d1017dc0e33 req-2224c92f-aa53-4528-abfb-95753cfc2d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4f9c42-f07a-4f40-aad4-702d0fd26d82", "name": "network-vif-plugged", "status": "completed", "tag": "c4b7f0c6-bfe4-49e1-936d-f15129c212a8"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:26.609673 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:26.609673 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:28:26.619830 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-a521bf1e-a4b4-4722-9525-4d1017dc0e33 req-2224c92f-aa53-4528-abfb-95753cfc2d87 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:26.620056 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-a521bf1e-a4b4-4722-9525-4d1017dc0e33 req-2224c92f-aa53-4528-abfb-95753cfc2d87 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:26.637961 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-a521bf1e-a4b4-4722-9525-4d1017dc0e33 req-2224c92f-aa53-4528-abfb-95753cfc2d87 service nova] Creating event network-vif-plugged:c4b7f0c6-bfe4-49e1-936d-f15129c212a8 for instance 4d4f9c42-f07a-4f40-aad4-702d0fd26d82 on hv-cinder-75994 Feb 17 03:28:26.642993 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-a521bf1e-a4b4-4722-9525-4d1017dc0e33 req-2224c92f-aa53-4528-abfb-95753cfc2d87 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039742 Feb 17 03:28:26.643737 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 69/147] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:26.728344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c782e8d2-ad11-4b09-90ae-c3300a154a34 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:26.729017 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c782e8d2-ad11-4b09-90ae-c3300a154a34 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:26.737274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c782e8d2-ad11-4b09-90ae-c3300a154a34 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:26.737786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c782e8d2-ad11-4b09-90ae-c3300a154a34 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:26.739134 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c782e8d2-ad11-4b09-90ae-c3300a154a34 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:26.739134 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c782e8d2-ad11-4b09-90ae-c3300a154a34 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:27.010622 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c782e8d2-ad11-4b09-90ae-c3300a154a34 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:27.019507 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c782e8d2-ad11-4b09-90ae-c3300a154a34 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.295557 Feb 17 03:28:27.020164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 79/148] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:26 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:27.193978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d33eba71-de2c-4b11-a4eb-1ad85617f0d4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:27.194807 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d33eba71-de2c-4b11-a4eb-1ad85617f0d4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:27.203738 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d33eba71-de2c-4b11-a4eb-1ad85617f0d4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:27.204287 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d33eba71-de2c-4b11-a4eb-1ad85617f0d4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:27.205166 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d33eba71-de2c-4b11-a4eb-1ad85617f0d4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:27.205666 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d33eba71-de2c-4b11-a4eb-1ad85617f0d4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:27.239322 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a1b47944-beb9-42b4-8bf0-0f12eb93cd9d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:27.240335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a1b47944-beb9-42b4-8bf0-0f12eb93cd9d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:27.249313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1b47944-beb9-42b4-8bf0-0f12eb93cd9d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:27.250231 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1b47944-beb9-42b4-8bf0-0f12eb93cd9d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:27.251370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1b47944-beb9-42b4-8bf0-0f12eb93cd9d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:27.252072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1b47944-beb9-42b4-8bf0-0f12eb93cd9d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:27.485228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d33eba71-de2c-4b11-a4eb-1ad85617f0d4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:27.494741 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d33eba71-de2c-4b11-a4eb-1ad85617f0d4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:27.496344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d33eba71-de2c-4b11-a4eb-1ad85617f0d4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:27.497512 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d33eba71-de2c-4b11-a4eb-1ad85617f0d4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.308704 Feb 17 03:28:27.498433 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 70/149] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:27 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:27.511606 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a1b47944-beb9-42b4-8bf0-0f12eb93cd9d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:27.521279 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a1b47944-beb9-42b4-8bf0-0f12eb93cd9d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.285730 Feb 17 03:28:27.522627 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 80/150] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:27 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:28.038078 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-72f095fe-d7de-48d9-ac1d-5870261077f2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:28.038749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-72f095fe-d7de-48d9-ac1d-5870261077f2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:28.046617 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-72f095fe-d7de-48d9-ac1d-5870261077f2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:28.047126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-72f095fe-d7de-48d9-ac1d-5870261077f2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:28.047965 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-72f095fe-d7de-48d9-ac1d-5870261077f2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:28.048491 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-72f095fe-d7de-48d9-ac1d-5870261077f2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:28.255970 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-72f095fe-d7de-48d9-ac1d-5870261077f2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:28.265383 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-72f095fe-d7de-48d9-ac1d-5870261077f2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.231312 Feb 17 03:28:28.265968 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 71/151] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:28 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:28.516380 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-95b42b7a-02d1-40ac-8872-79ae7c75c75f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:28.516984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-95b42b7a-02d1-40ac-8872-79ae7c75c75f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:28.524868 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95b42b7a-02d1-40ac-8872-79ae7c75c75f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:28.525433 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95b42b7a-02d1-40ac-8872-79ae7c75c75f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:28.526266 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95b42b7a-02d1-40ac-8872-79ae7c75c75f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:28.526759 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95b42b7a-02d1-40ac-8872-79ae7c75c75f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:28.539853 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ccaa5b00-a8d6-43bd-8238-6a21100303fd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:28.541076 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ccaa5b00-a8d6-43bd-8238-6a21100303fd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:28.548892 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ccaa5b00-a8d6-43bd-8238-6a21100303fd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:28.549442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ccaa5b00-a8d6-43bd-8238-6a21100303fd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:28.550271 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ccaa5b00-a8d6-43bd-8238-6a21100303fd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:28.550755 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ccaa5b00-a8d6-43bd-8238-6a21100303fd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:28.762415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-95b42b7a-02d1-40ac-8872-79ae7c75c75f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:28.772223 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-95b42b7a-02d1-40ac-8872-79ae7c75c75f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:28.773754 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-95b42b7a-02d1-40ac-8872-79ae7c75c75f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:28.775465 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-95b42b7a-02d1-40ac-8872-79ae7c75c75f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.262656 Feb 17 03:28:28.776099 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 81/152] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:28 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:28.977125 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ccaa5b00-a8d6-43bd-8238-6a21100303fd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:28.986646 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ccaa5b00-a8d6-43bd-8238-6a21100303fd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.450830 Feb 17 03:28:28.987219 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 72/153] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:28 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:29.282913 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a901fb48-e7e5-4f30-b498-9d572259d7ef tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:29.283519 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a901fb48-e7e5-4f30-b498-9d572259d7ef tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:29.291741 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a901fb48-e7e5-4f30-b498-9d572259d7ef tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:29.292242 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a901fb48-e7e5-4f30-b498-9d572259d7ef tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:29.293082 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a901fb48-e7e5-4f30-b498-9d572259d7ef tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:29.293567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a901fb48-e7e5-4f30-b498-9d572259d7ef tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:29.500486 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a901fb48-e7e5-4f30-b498-9d572259d7ef tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:29.509902 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a901fb48-e7e5-4f30-b498-9d572259d7ef tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.230139 Feb 17 03:28:29.510265 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 82/154] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:29 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:29.793714 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-24055847-cfa3-4151-a142-e118ca65a1ab tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:29.794474 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-24055847-cfa3-4151-a142-e118ca65a1ab tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:29.803064 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-24055847-cfa3-4151-a142-e118ca65a1ab tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:29.803566 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-24055847-cfa3-4151-a142-e118ca65a1ab tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:29.804393 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-24055847-cfa3-4151-a142-e118ca65a1ab tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:29.804857 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-24055847-cfa3-4151-a142-e118ca65a1ab tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:30.004145 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4ec9703e-f248-40a2-9a94-41308ef24525 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:30.005101 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4ec9703e-f248-40a2-9a94-41308ef24525 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:30.013138 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ec9703e-f248-40a2-9a94-41308ef24525 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:30.013626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ec9703e-f248-40a2-9a94-41308ef24525 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:30.014544 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ec9703e-f248-40a2-9a94-41308ef24525 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:30.015065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ec9703e-f248-40a2-9a94-41308ef24525 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:30.021330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-24055847-cfa3-4151-a142-e118ca65a1ab tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:30.030687 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-24055847-cfa3-4151-a142-e118ca65a1ab tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:30.032243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-24055847-cfa3-4151-a142-e118ca65a1ab tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:30.033400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-24055847-cfa3-4151-a142-e118ca65a1ab tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.243877 Feb 17 03:28:30.033986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 73/155] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:29 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:30.225630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4ec9703e-f248-40a2-9a94-41308ef24525 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:30.234757 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4ec9703e-f248-40a2-9a94-41308ef24525 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.234721 Feb 17 03:28:30.235346 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 83/156] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:29 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:30.527345 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8fbeeb80-5d93-49ac-9cdc-32cdac180a8d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:30.527980 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8fbeeb80-5d93-49ac-9cdc-32cdac180a8d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:30.535851 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8fbeeb80-5d93-49ac-9cdc-32cdac180a8d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:30.536347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8fbeeb80-5d93-49ac-9cdc-32cdac180a8d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:30.537198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8fbeeb80-5d93-49ac-9cdc-32cdac180a8d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:30.537686 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8fbeeb80-5d93-49ac-9cdc-32cdac180a8d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:30.743435 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8fbeeb80-5d93-49ac-9cdc-32cdac180a8d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:30.752118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8fbeeb80-5d93-49ac-9cdc-32cdac180a8d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.229278 Feb 17 03:28:30.752728 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 74/157] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:30 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:31.052844 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-940ee335-e1e3-45f5-a7e0-37ecf5a3ae3a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:31.053602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-940ee335-e1e3-45f5-a7e0-37ecf5a3ae3a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:31.061960 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-940ee335-e1e3-45f5-a7e0-37ecf5a3ae3a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:31.062472 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-940ee335-e1e3-45f5-a7e0-37ecf5a3ae3a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:31.063319 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-940ee335-e1e3-45f5-a7e0-37ecf5a3ae3a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:31.063813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-940ee335-e1e3-45f5-a7e0-37ecf5a3ae3a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:31.253107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4c441dc1-c14a-477c-a13f-f20e68878499 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:31.253776 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4c441dc1-c14a-477c-a13f-f20e68878499 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:31.262094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c441dc1-c14a-477c-a13f-f20e68878499 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:31.262592 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c441dc1-c14a-477c-a13f-f20e68878499 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:31.263419 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c441dc1-c14a-477c-a13f-f20e68878499 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:31.263904 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c441dc1-c14a-477c-a13f-f20e68878499 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:31.276670 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-940ee335-e1e3-45f5-a7e0-37ecf5a3ae3a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:31.286207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-940ee335-e1e3-45f5-a7e0-37ecf5a3ae3a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:31.287872 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-940ee335-e1e3-45f5-a7e0-37ecf5a3ae3a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:31.289083 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-940ee335-e1e3-45f5-a7e0-37ecf5a3ae3a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.240381 Feb 17 03:28:31.289637 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 84/158] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:31 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:31.473472 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4c441dc1-c14a-477c-a13f-f20e68878499 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:31.483007 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4c441dc1-c14a-477c-a13f-f20e68878499 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.233997 Feb 17 03:28:31.483603 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 75/159] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:31 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:31.770297 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-74467dd4-67ad-4629-97fc-2cbf88664295 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:31.770901 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-74467dd4-67ad-4629-97fc-2cbf88664295 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:31.779311 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-74467dd4-67ad-4629-97fc-2cbf88664295 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:31.779812 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-74467dd4-67ad-4629-97fc-2cbf88664295 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:31.780630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-74467dd4-67ad-4629-97fc-2cbf88664295 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:31.781137 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-74467dd4-67ad-4629-97fc-2cbf88664295 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:31.996655 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-74467dd4-67ad-4629-97fc-2cbf88664295 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:32.007105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-74467dd4-67ad-4629-97fc-2cbf88664295 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.240629 Feb 17 03:28:32.007909 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 85/160] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:31 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:32.306853 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8ac3bf6f-ce20-4541-931e-8a9817165a63 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:32.307554 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8ac3bf6f-ce20-4541-931e-8a9817165a63 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:32.315327 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ac3bf6f-ce20-4541-931e-8a9817165a63 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:32.315821 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ac3bf6f-ce20-4541-931e-8a9817165a63 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:32.316648 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ac3bf6f-ce20-4541-931e-8a9817165a63 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:32.317159 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ac3bf6f-ce20-4541-931e-8a9817165a63 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:32.500936 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-87766b1f-a033-440a-bdae-55891304d3aa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:32.501665 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-87766b1f-a033-440a-bdae-55891304d3aa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:32.510212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-87766b1f-a033-440a-bdae-55891304d3aa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:32.510715 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-87766b1f-a033-440a-bdae-55891304d3aa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:32.511553 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-87766b1f-a033-440a-bdae-55891304d3aa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:32.512039 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-87766b1f-a033-440a-bdae-55891304d3aa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:32.526244 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8ac3bf6f-ce20-4541-931e-8a9817165a63 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:32.535813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8ac3bf6f-ce20-4541-931e-8a9817165a63 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:32.537424 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8ac3bf6f-ce20-4541-931e-8a9817165a63 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:32.538556 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8ac3bf6f-ce20-4541-931e-8a9817165a63 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.235724 Feb 17 03:28:32.539134 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 76/161] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:32 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:32.724848 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-87766b1f-a033-440a-bdae-55891304d3aa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:32.733733 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-87766b1f-a033-440a-bdae-55891304d3aa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.237438 Feb 17 03:28:32.734318 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 86/162] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:32 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:33.025232 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-02205dc0-10c5-4f09-a9a4-cd11eb052c55 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:33.025909 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-02205dc0-10c5-4f09-a9a4-cd11eb052c55 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:33.033590 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-02205dc0-10c5-4f09-a9a4-cd11eb052c55 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:33.034091 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-02205dc0-10c5-4f09-a9a4-cd11eb052c55 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:33.034927 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-02205dc0-10c5-4f09-a9a4-cd11eb052c55 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:33.035420 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-02205dc0-10c5-4f09-a9a4-cd11eb052c55 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:33.252863 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-02205dc0-10c5-4f09-a9a4-cd11eb052c55 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:33.261567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-02205dc0-10c5-4f09-a9a4-cd11eb052c55 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.240271 Feb 17 03:28:33.262154 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 77/163] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:33 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:33.557475 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-453fff1b-c477-4003-b2a4-6554d8085425 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:33.558225 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-453fff1b-c477-4003-b2a4-6554d8085425 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:33.566517 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-453fff1b-c477-4003-b2a4-6554d8085425 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:33.567016 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-453fff1b-c477-4003-b2a4-6554d8085425 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:33.567845 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-453fff1b-c477-4003-b2a4-6554d8085425 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:33.568332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-453fff1b-c477-4003-b2a4-6554d8085425 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:33.751856 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0e06b266-7227-43f2-be31-553ed82402b3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:33.752578 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0e06b266-7227-43f2-be31-553ed82402b3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:33.760907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0e06b266-7227-43f2-be31-553ed82402b3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:33.761470 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0e06b266-7227-43f2-be31-553ed82402b3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:33.762541 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0e06b266-7227-43f2-be31-553ed82402b3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:33.763015 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0e06b266-7227-43f2-be31-553ed82402b3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:33.784745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-453fff1b-c477-4003-b2a4-6554d8085425 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:33.794873 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-453fff1b-c477-4003-b2a4-6554d8085425 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:33.796682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-453fff1b-c477-4003-b2a4-6554d8085425 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:33.798079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-453fff1b-c477-4003-b2a4-6554d8085425 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.244728 Feb 17 03:28:33.798700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 87/164] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:33 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:33.980921 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0e06b266-7227-43f2-be31-553ed82402b3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:33.990543 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0e06b266-7227-43f2-be31-553ed82402b3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.242640 Feb 17 03:28:33.991103 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 78/165] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:33 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:34.279959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3abf51f8-356a-468c-860a-b070a397daf6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:34.280876 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3abf51f8-356a-468c-860a-b070a397daf6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:34.289738 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3abf51f8-356a-468c-860a-b070a397daf6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:34.290453 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3abf51f8-356a-468c-860a-b070a397daf6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:34.291438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3abf51f8-356a-468c-860a-b070a397daf6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:34.292038 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3abf51f8-356a-468c-860a-b070a397daf6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:34.529487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3abf51f8-356a-468c-860a-b070a397daf6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:34.541917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3abf51f8-356a-468c-860a-b070a397daf6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.266332 Feb 17 03:28:34.542844 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 88/166] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:34 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:34.818273 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-caf6fee6-578e-4825-89a8-3b286b14ff91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:34.819218 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-caf6fee6-578e-4825-89a8-3b286b14ff91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:34.828438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-caf6fee6-578e-4825-89a8-3b286b14ff91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:34.828950 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-caf6fee6-578e-4825-89a8-3b286b14ff91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:34.829828 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-caf6fee6-578e-4825-89a8-3b286b14ff91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:34.830322 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-caf6fee6-578e-4825-89a8-3b286b14ff91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:35.008963 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f9192f9b-8e3b-4f4f-a71c-9bb31b15d8eb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:35.009827 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f9192f9b-8e3b-4f4f-a71c-9bb31b15d8eb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:35.017883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f9192f9b-8e3b-4f4f-a71c-9bb31b15d8eb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:35.018476 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f9192f9b-8e3b-4f4f-a71c-9bb31b15d8eb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:35.021263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f9192f9b-8e3b-4f4f-a71c-9bb31b15d8eb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:35.021263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f9192f9b-8e3b-4f4f-a71c-9bb31b15d8eb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:35.243946 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f9192f9b-8e3b-4f4f-a71c-9bb31b15d8eb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:35.252686 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f9192f9b-8e3b-4f4f-a71c-9bb31b15d8eb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1321 microversion: 2.1 time: 0.248643 Feb 17 03:28:35.253518 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 89/167] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:35 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:35.349943 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-caf6fee6-578e-4825-89a8-3b286b14ff91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:35.363353 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-caf6fee6-578e-4825-89a8-3b286b14ff91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:35.365126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-caf6fee6-578e-4825-89a8-3b286b14ff91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:35.366847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-caf6fee6-578e-4825-89a8-3b286b14ff91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.553575 Feb 17 03:28:35.367443 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 79/168] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:34 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:35.561160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5eb9e01b-4a3e-46f0-8533-1d83771033e8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:35.563020 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5eb9e01b-4a3e-46f0-8533-1d83771033e8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:35.583851 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5eb9e01b-4a3e-46f0-8533-1d83771033e8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:35.584655 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5eb9e01b-4a3e-46f0-8533-1d83771033e8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:35.589939 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5eb9e01b-4a3e-46f0-8533-1d83771033e8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:35.590668 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5eb9e01b-4a3e-46f0-8533-1d83771033e8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:35.884145 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5eb9e01b-4a3e-46f0-8533-1d83771033e8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:35.893163 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5eb9e01b-4a3e-46f0-8533-1d83771033e8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.337062 Feb 17 03:28:35.893996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 90/169] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:35 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:36.271260 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a71dbcca-57b9-4c72-adfd-a3ab482ff5b0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:36.271900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a71dbcca-57b9-4c72-adfd-a3ab482ff5b0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:36.280695 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a71dbcca-57b9-4c72-adfd-a3ab482ff5b0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:36.281313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a71dbcca-57b9-4c72-adfd-a3ab482ff5b0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:36.282153 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a71dbcca-57b9-4c72-adfd-a3ab482ff5b0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:36.282638 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a71dbcca-57b9-4c72-adfd-a3ab482ff5b0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:36.387368 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7f52b19e-4500-4659-ab45-0e97e9e41b4f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:36.388592 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7f52b19e-4500-4659-ab45-0e97e9e41b4f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:36.428742 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f52b19e-4500-4659-ab45-0e97e9e41b4f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:36.433355 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f52b19e-4500-4659-ab45-0e97e9e41b4f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:36.434239 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f52b19e-4500-4659-ab45-0e97e9e41b4f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:36.436994 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f52b19e-4500-4659-ab45-0e97e9e41b4f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:36.564277 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a71dbcca-57b9-4c72-adfd-a3ab482ff5b0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:36.573509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a71dbcca-57b9-4c72-adfd-a3ab482ff5b0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1515 microversion: 2.1 time: 0.306185 Feb 17 03:28:36.586216 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 80/170] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:36 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1515 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:36.592908 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1ad94519-9b0c-4d34-9a2a-aa1e7ceaaf6b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:36.594106 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1ad94519-9b0c-4d34-9a2a-aa1e7ceaaf6b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:36.604985 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1ad94519-9b0c-4d34-9a2a-aa1e7ceaaf6b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:36.604985 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1ad94519-9b0c-4d34-9a2a-aa1e7ceaaf6b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:36.605652 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1ad94519-9b0c-4d34-9a2a-aa1e7ceaaf6b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:36.606415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1ad94519-9b0c-4d34-9a2a-aa1e7ceaaf6b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:36.671880 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-1ad94519-9b0c-4d34-9a2a-aa1e7ceaaf6b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lazy-loading 'flavor' on Instance uuid 4d4f9c42-f07a-4f40-aad4-702d0fd26d82 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:28:36.786235 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7f52b19e-4500-4659-ab45-0e97e9e41b4f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:36.798199 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7f52b19e-4500-4659-ab45-0e97e9e41b4f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:36.799796 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7f52b19e-4500-4659-ab45-0e97e9e41b4f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:36.800966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7f52b19e-4500-4659-ab45-0e97e9e41b4f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.419571 Feb 17 03:28:36.801775 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 91/171] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:36 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:36.911298 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c3fe13d3-0e9e-4d1f-9da2-cfe3502fc6c1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:36.911952 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c3fe13d3-0e9e-4d1f-9da2-cfe3502fc6c1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:36.941374 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3fe13d3-0e9e-4d1f-9da2-cfe3502fc6c1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:36.941882 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3fe13d3-0e9e-4d1f-9da2-cfe3502fc6c1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:36.942751 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3fe13d3-0e9e-4d1f-9da2-cfe3502fc6c1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:36.943244 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3fe13d3-0e9e-4d1f-9da2-cfe3502fc6c1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:36.946943 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1ad94519-9b0c-4d34-9a2a-aa1e7ceaaf6b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "POST /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82/action" status: 200 len: 32 microversion: 2.1 time: 0.359150 Feb 17 03:28:36.947785 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 81/172] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:28:36 2021] POST /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82/action => generated 32 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:28:36.957839 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-082d7685-dba7-46b9-8c4a-0822a304a797 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:36.958605 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-082d7685-dba7-46b9-8c4a-0822a304a797 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:36.985217 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-082d7685-dba7-46b9-8c4a-0822a304a797 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:36.985931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-082d7685-dba7-46b9-8c4a-0822a304a797 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:36.987222 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-082d7685-dba7-46b9-8c4a-0822a304a797 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:36.987918 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-082d7685-dba7-46b9-8c4a-0822a304a797 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:37.216743 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-082d7685-dba7-46b9-8c4a-0822a304a797 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:37.228624 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-082d7685-dba7-46b9-8c4a-0822a304a797 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.274384 Feb 17 03:28:37.229263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 82/173] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:36 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:37.268089 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c3fe13d3-0e9e-4d1f-9da2-cfe3502fc6c1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:37.277838 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c3fe13d3-0e9e-4d1f-9da2-cfe3502fc6c1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.370385 Feb 17 03:28:37.278591 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 92/174] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:36 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:37.819955 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0f4fe6dc-0fb1-4f80-98c2-7397dbac9294 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:37.820586 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0f4fe6dc-0fb1-4f80-98c2-7397dbac9294 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:37.831206 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0f4fe6dc-0fb1-4f80-98c2-7397dbac9294 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:37.831921 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0f4fe6dc-0fb1-4f80-98c2-7397dbac9294 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:37.832759 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0f4fe6dc-0fb1-4f80-98c2-7397dbac9294 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:37.833272 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0f4fe6dc-0fb1-4f80-98c2-7397dbac9294 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:38.067901 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0f4fe6dc-0fb1-4f80-98c2-7397dbac9294 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:38.078481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0f4fe6dc-0fb1-4f80-98c2-7397dbac9294 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:38.080215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0f4fe6dc-0fb1-4f80-98c2-7397dbac9294 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:38.081388 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0f4fe6dc-0fb1-4f80-98c2-7397dbac9294 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.265620 Feb 17 03:28:38.082139 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 83/175] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:37 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:38.248069 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4a2ba8e5-29bc-4cf7-964b-80df4c61cba4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:38.248937 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4a2ba8e5-29bc-4cf7-964b-80df4c61cba4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:38.258131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4a2ba8e5-29bc-4cf7-964b-80df4c61cba4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:38.258632 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4a2ba8e5-29bc-4cf7-964b-80df4c61cba4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:38.259469 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4a2ba8e5-29bc-4cf7-964b-80df4c61cba4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:38.260099 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4a2ba8e5-29bc-4cf7-964b-80df4c61cba4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:38.300627 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-57143372-c057-400d-9f58-1942954dc5fb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:38.301649 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-57143372-c057-400d-9f58-1942954dc5fb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:38.312328 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-57143372-c057-400d-9f58-1942954dc5fb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:38.313001 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-57143372-c057-400d-9f58-1942954dc5fb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:38.314328 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-57143372-c057-400d-9f58-1942954dc5fb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:38.314880 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-57143372-c057-400d-9f58-1942954dc5fb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:38.530565 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4a2ba8e5-29bc-4cf7-964b-80df4c61cba4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:38.541212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4a2ba8e5-29bc-4cf7-964b-80df4c61cba4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.298239 Feb 17 03:28:38.542753 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 93/176] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:38 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:38.587046 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-57143372-c057-400d-9f58-1942954dc5fb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:38.596022 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-57143372-c057-400d-9f58-1942954dc5fb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.303526 Feb 17 03:28:38.596801 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 84/177] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:38 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:39.100164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8a90a71a-6a04-439b-8942-07f62eed3e01 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:39.101097 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8a90a71a-6a04-439b-8942-07f62eed3e01 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:39.109462 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a90a71a-6a04-439b-8942-07f62eed3e01 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:39.109977 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a90a71a-6a04-439b-8942-07f62eed3e01 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:39.110863 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a90a71a-6a04-439b-8942-07f62eed3e01 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:39.111358 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a90a71a-6a04-439b-8942-07f62eed3e01 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:39.325356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8a90a71a-6a04-439b-8942-07f62eed3e01 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:39.335099 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8a90a71a-6a04-439b-8942-07f62eed3e01 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:39.336686 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8a90a71a-6a04-439b-8942-07f62eed3e01 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:39.338355 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8a90a71a-6a04-439b-8942-07f62eed3e01 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.242376 Feb 17 03:28:39.338931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 94/178] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:39 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:39.560189 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3ec99607-4825-45b9-ae31-387068f5662d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:39.560844 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3ec99607-4825-45b9-ae31-387068f5662d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:39.569307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3ec99607-4825-45b9-ae31-387068f5662d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:39.569813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3ec99607-4825-45b9-ae31-387068f5662d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:39.570643 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3ec99607-4825-45b9-ae31-387068f5662d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:39.571162 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3ec99607-4825-45b9-ae31-387068f5662d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:39.613866 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-17341299-43e4-42c8-889f-f2036230544f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:39.614523 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-17341299-43e4-42c8-889f-f2036230544f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:39.623011 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-17341299-43e4-42c8-889f-f2036230544f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:39.623011 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-17341299-43e4-42c8-889f-f2036230544f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:39.623633 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-17341299-43e4-42c8-889f-f2036230544f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:39.624113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-17341299-43e4-42c8-889f-f2036230544f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:39.808377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3ec99607-4825-45b9-ae31-387068f5662d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:39.817433 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3ec99607-4825-45b9-ae31-387068f5662d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.261360 Feb 17 03:28:39.818028 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 85/179] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:39 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:39.945402 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-17341299-43e4-42c8-889f-f2036230544f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:39.954922 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-17341299-43e4-42c8-889f-f2036230544f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.344995 Feb 17 03:28:39.955521 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 95/180] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:39 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:40.357839 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1546e972-f5c0-4a58-8cbf-ef78a6e83e31 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:40.358642 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1546e972-f5c0-4a58-8cbf-ef78a6e83e31 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:40.366446 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1546e972-f5c0-4a58-8cbf-ef78a6e83e31 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:40.366900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1546e972-f5c0-4a58-8cbf-ef78a6e83e31 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:40.367732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1546e972-f5c0-4a58-8cbf-ef78a6e83e31 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:40.368858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1546e972-f5c0-4a58-8cbf-ef78a6e83e31 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:40.672302 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1546e972-f5c0-4a58-8cbf-ef78a6e83e31 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:40.682415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1546e972-f5c0-4a58-8cbf-ef78a6e83e31 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:40.683995 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1546e972-f5c0-4a58-8cbf-ef78a6e83e31 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:40.685165 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1546e972-f5c0-4a58-8cbf-ef78a6e83e31 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.331357 Feb 17 03:28:40.685745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 86/181] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:40 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:40.836095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e3c6ad11-8cc6-4fcd-8d68-23ee4a45e936 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:40.837704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e3c6ad11-8cc6-4fcd-8d68-23ee4a45e936 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:40.845902 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e3c6ad11-8cc6-4fcd-8d68-23ee4a45e936 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:40.846558 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e3c6ad11-8cc6-4fcd-8d68-23ee4a45e936 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:40.847688 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e3c6ad11-8cc6-4fcd-8d68-23ee4a45e936 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:40.848197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e3c6ad11-8cc6-4fcd-8d68-23ee4a45e936 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:40.973374 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ac8d5ee0-786a-45bd-a7d6-0a683528519b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:40.974084 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ac8d5ee0-786a-45bd-a7d6-0a683528519b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:40.991339 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac8d5ee0-786a-45bd-a7d6-0a683528519b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:40.992110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac8d5ee0-786a-45bd-a7d6-0a683528519b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:40.993353 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac8d5ee0-786a-45bd-a7d6-0a683528519b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:40.994048 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac8d5ee0-786a-45bd-a7d6-0a683528519b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:41.253102 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e3c6ad11-8cc6-4fcd-8d68-23ee4a45e936 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:41.264399 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e3c6ad11-8cc6-4fcd-8d68-23ee4a45e936 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.432011 Feb 17 03:28:41.266109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 96/182] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:40 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:41.286479 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ac8d5ee0-786a-45bd-a7d6-0a683528519b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:41.298612 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ac8d5ee0-786a-45bd-a7d6-0a683528519b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.329188 Feb 17 03:28:41.299232 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 87/183] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:40 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:41.704316 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-dbf42687-f1e9-49d4-87fd-3cbdddc94930 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:41.704985 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-dbf42687-f1e9-49d4-87fd-3cbdddc94930 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:41.713901 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dbf42687-f1e9-49d4-87fd-3cbdddc94930 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:41.714408 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dbf42687-f1e9-49d4-87fd-3cbdddc94930 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:41.715256 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dbf42687-f1e9-49d4-87fd-3cbdddc94930 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:41.715749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dbf42687-f1e9-49d4-87fd-3cbdddc94930 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:42.072038 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dbf42687-f1e9-49d4-87fd-3cbdddc94930 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:42.082368 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dbf42687-f1e9-49d4-87fd-3cbdddc94930 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:42.084260 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dbf42687-f1e9-49d4-87fd-3cbdddc94930 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:42.085664 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-dbf42687-f1e9-49d4-87fd-3cbdddc94930 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.385410 Feb 17 03:28:42.086409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 97/184] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:41 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:42.283147 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4bbbe0e0-4c65-461e-8779-b00ade744028 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:42.283809 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4bbbe0e0-4c65-461e-8779-b00ade744028 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:42.292098 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4bbbe0e0-4c65-461e-8779-b00ade744028 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:42.292581 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4bbbe0e0-4c65-461e-8779-b00ade744028 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:42.293619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4bbbe0e0-4c65-461e-8779-b00ade744028 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:42.294279 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4bbbe0e0-4c65-461e-8779-b00ade744028 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:42.317992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a70192e3-b2e8-45bf-870b-00bf68e7031d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:42.319177 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a70192e3-b2e8-45bf-870b-00bf68e7031d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:42.330180 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a70192e3-b2e8-45bf-870b-00bf68e7031d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:42.330894 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a70192e3-b2e8-45bf-870b-00bf68e7031d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:42.332414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a70192e3-b2e8-45bf-870b-00bf68e7031d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:42.333100 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a70192e3-b2e8-45bf-870b-00bf68e7031d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:42.582225 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a70192e3-b2e8-45bf-870b-00bf68e7031d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:42.591257 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a70192e3-b2e8-45bf-870b-00bf68e7031d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.279027 Feb 17 03:28:42.591852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 98/185] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:42 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:42.611537 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4bbbe0e0-4c65-461e-8779-b00ade744028 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:42.620836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4bbbe0e0-4c65-461e-8779-b00ade744028 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.341669 Feb 17 03:28:42.621483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 88/186] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:42 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:43.106893 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a7b4af99-7972-4f9d-8954-ac50c5b54a23 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:43.107567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a7b4af99-7972-4f9d-8954-ac50c5b54a23 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:43.116183 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a7b4af99-7972-4f9d-8954-ac50c5b54a23 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:43.116690 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a7b4af99-7972-4f9d-8954-ac50c5b54a23 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:43.117588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a7b4af99-7972-4f9d-8954-ac50c5b54a23 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:43.118135 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a7b4af99-7972-4f9d-8954-ac50c5b54a23 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:43.156104 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c8e3f322-bd40-4819-87d8-26e5a4920e7c tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:43.156655 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c8e3f322-bd40-4819-87d8-26e5a4920e7c tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:43.164811 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c8e3f322-bd40-4819-87d8-26e5a4920e7c tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:43.166004 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c8e3f322-bd40-4819-87d8-26e5a4920e7c tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:43.166981 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c8e3f322-bd40-4819-87d8-26e5a4920e7c tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:43.167322 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c8e3f322-bd40-4819-87d8-26e5a4920e7c tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:43.242442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c8e3f322-bd40-4819-87d8-26e5a4920e7c tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Going to try to terminate instance {{(pid=98103) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:28:43.359676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a7b4af99-7972-4f9d-8954-ac50c5b54a23 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:43.370978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a7b4af99-7972-4f9d-8954-ac50c5b54a23 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:43.372560 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a7b4af99-7972-4f9d-8954-ac50c5b54a23 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:43.374059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a7b4af99-7972-4f9d-8954-ac50c5b54a23 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.272008 Feb 17 03:28:43.374646 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 99/187] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:43 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:43.386576 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c8e3f322-bd40-4819-87d8-26e5a4920e7c tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 204 len: 0 microversion: 2.1 time: 0.234151 Feb 17 03:28:43.387204 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 89/188] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:28:43 2021] DELETE /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:28:43.396007 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-83328e41-17bb-4973-9924-f7fb2d59da7a tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:43.396673 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-83328e41-17bb-4973-9924-f7fb2d59da7a tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:43.406119 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-83328e41-17bb-4973-9924-f7fb2d59da7a tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:43.406626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-83328e41-17bb-4973-9924-f7fb2d59da7a tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:43.407464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-83328e41-17bb-4973-9924-f7fb2d59da7a tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:43.407950 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-83328e41-17bb-4973-9924-f7fb2d59da7a tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:43.609587 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-aa82effc-6c67-4686-9dc4-616044f51957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:43.610430 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-aa82effc-6c67-4686-9dc4-616044f51957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:43.626184 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aa82effc-6c67-4686-9dc4-616044f51957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:43.626695 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aa82effc-6c67-4686-9dc4-616044f51957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:43.627559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aa82effc-6c67-4686-9dc4-616044f51957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:43.628048 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aa82effc-6c67-4686-9dc4-616044f51957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:43.671400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-83328e41-17bb-4973-9924-f7fb2d59da7a tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:43.686275 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-83328e41-17bb-4973-9924-f7fb2d59da7a tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1551 microversion: 2.1 time: 0.294582 Feb 17 03:28:43.686958 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 100/189] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:43 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1551 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:43.695736 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-efb6cc94-99c9-4f0e-a6cd-73d14a8f7617 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:43.696970 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-efb6cc94-99c9-4f0e-a6cd-73d14a8f7617 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:43.710571 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-efb6cc94-99c9-4f0e-a6cd-73d14a8f7617 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:43.711078 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-efb6cc94-99c9-4f0e-a6cd-73d14a8f7617 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:43.712638 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-efb6cc94-99c9-4f0e-a6cd-73d14a8f7617 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:43.713364 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-efb6cc94-99c9-4f0e-a6cd-73d14a8f7617 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:43.931283 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-aa82effc-6c67-4686-9dc4-616044f51957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:43.942754 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-aa82effc-6c67-4686-9dc4-616044f51957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.337551 Feb 17 03:28:43.944566 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 90/190] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:43 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:44.192102 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-efb6cc94-99c9-4f0e-a6cd-73d14a8f7617 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:44.201219 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-efb6cc94-99c9-4f0e-a6cd-73d14a8f7617 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.513172 Feb 17 03:28:44.201795 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 101/191] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:43 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:44.394599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ab37360f-e04e-4bff-a414-864498668544 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:44.395633 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ab37360f-e04e-4bff-a414-864498668544 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:44.411158 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ab37360f-e04e-4bff-a414-864498668544 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:44.412064 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ab37360f-e04e-4bff-a414-864498668544 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:44.413415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ab37360f-e04e-4bff-a414-864498668544 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:44.414242 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ab37360f-e04e-4bff-a414-864498668544 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:44.707297 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9a4709cf-e873-4a05-95a6-35e6a71842d4 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:44.707971 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9a4709cf-e873-4a05-95a6-35e6a71842d4 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:44.719614 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a4709cf-e873-4a05-95a6-35e6a71842d4 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:44.720118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a4709cf-e873-4a05-95a6-35e6a71842d4 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:44.720959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a4709cf-e873-4a05-95a6-35e6a71842d4 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:44.722001 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a4709cf-e873-4a05-95a6-35e6a71842d4 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:44.775051 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ab37360f-e04e-4bff-a414-864498668544 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:44.786992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ab37360f-e04e-4bff-a414-864498668544 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:44.789152 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ab37360f-e04e-4bff-a414-864498668544 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:44.791055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ab37360f-e04e-4bff-a414-864498668544 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.400540 Feb 17 03:28:44.791847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 91/192] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:44 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:28:44.961128 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-73319b51-c6a6-433f-bf35-4e4afab6fa2f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:44.962439 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-73319b51-c6a6-433f-bf35-4e4afab6fa2f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:44.970679 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73319b51-c6a6-433f-bf35-4e4afab6fa2f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:44.971192 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73319b51-c6a6-433f-bf35-4e4afab6fa2f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:44.972029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73319b51-c6a6-433f-bf35-4e4afab6fa2f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:44.972516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73319b51-c6a6-433f-bf35-4e4afab6fa2f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:45.012204 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9a4709cf-e873-4a05-95a6-35e6a71842d4 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:45.023942 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9a4709cf-e873-4a05-95a6-35e6a71842d4 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1551 microversion: 2.1 time: 0.321558 Feb 17 03:28:45.026392 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 102/193] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:44 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1551 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:45.219730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-254e6be3-c4cb-48a2-b168-a56d11716fd3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:45.220591 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-254e6be3-c4cb-48a2-b168-a56d11716fd3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:45.228509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-254e6be3-c4cb-48a2-b168-a56d11716fd3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:45.229018 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-254e6be3-c4cb-48a2-b168-a56d11716fd3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:45.229885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-254e6be3-c4cb-48a2-b168-a56d11716fd3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:45.230372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-254e6be3-c4cb-48a2-b168-a56d11716fd3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:45.461833 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-254e6be3-c4cb-48a2-b168-a56d11716fd3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:45.471751 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-254e6be3-c4cb-48a2-b168-a56d11716fd3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.255927 Feb 17 03:28:45.472345 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 103/194] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:45 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:45.487403 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-3bc78e35-6687-4e3d-b9d8-02ace178e5e8 req-2821c87c-a1bf-40c5-b365-696bb8ca906e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4840bec6-59fa-4a75-9cab-b8eba3fced9d", "name": "network-vif-plugged", "status": "completed", "tag": "3122eba0-b4d4-415e-b7c0-f67223c6ab3f"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:45.489235 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:45.489235 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:28:45.498520 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-3bc78e35-6687-4e3d-b9d8-02ace178e5e8 req-2821c87c-a1bf-40c5-b365-696bb8ca906e service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:45.499021 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-3bc78e35-6687-4e3d-b9d8-02ace178e5e8 req-2821c87c-a1bf-40c5-b365-696bb8ca906e service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:45.518958 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-3bc78e35-6687-4e3d-b9d8-02ace178e5e8 req-2821c87c-a1bf-40c5-b365-696bb8ca906e service nova] Creating event network-vif-plugged:3122eba0-b4d4-415e-b7c0-f67223c6ab3f for instance 4840bec6-59fa-4a75-9cab-b8eba3fced9d on hv-cinder-75994 Feb 17 03:28:45.524089 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-3bc78e35-6687-4e3d-b9d8-02ace178e5e8 req-2821c87c-a1bf-40c5-b365-696bb8ca906e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040563 Feb 17 03:28:45.524778 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 104/195] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:45.604877 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-73319b51-c6a6-433f-bf35-4e4afab6fa2f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:45.625163 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-73319b51-c6a6-433f-bf35-4e4afab6fa2f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.667906 Feb 17 03:28:45.626021 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 92/196] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:44 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:45.813466 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6033978d-abee-4540-9723-b1bc06f08c71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:45.814536 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6033978d-abee-4540-9723-b1bc06f08c71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:45.827890 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6033978d-abee-4540-9723-b1bc06f08c71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:45.828408 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6033978d-abee-4540-9723-b1bc06f08c71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:45.829416 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6033978d-abee-4540-9723-b1bc06f08c71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:45.829907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6033978d-abee-4540-9723-b1bc06f08c71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:46.052529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6e0e0239-52f3-4c70-bc79-3703e11cbe24 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:46.053621 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6e0e0239-52f3-4c70-bc79-3703e11cbe24 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:46.062376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e0e0239-52f3-4c70-bc79-3703e11cbe24 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:46.063184 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e0e0239-52f3-4c70-bc79-3703e11cbe24 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:46.064385 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e0e0239-52f3-4c70-bc79-3703e11cbe24 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:46.065101 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e0e0239-52f3-4c70-bc79-3703e11cbe24 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:46.156963 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6033978d-abee-4540-9723-b1bc06f08c71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:46.167465 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6033978d-abee-4540-9723-b1bc06f08c71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:46.169230 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6033978d-abee-4540-9723-b1bc06f08c71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:46.170513 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6033978d-abee-4540-9723-b1bc06f08c71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.361917 Feb 17 03:28:46.171384 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 105/197] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:45 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:46.303098 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6e0e0239-52f3-4c70-bc79-3703e11cbe24 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:46.317351 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6e0e0239-52f3-4c70-bc79-3703e11cbe24 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1551 microversion: 2.1 time: 0.268543 Feb 17 03:28:46.318011 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 93/198] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:46 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1551 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:46.490131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-dc7d0176-8801-4353-a386-1f9aaddaea83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:46.490811 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-dc7d0176-8801-4353-a386-1f9aaddaea83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:46.498908 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dc7d0176-8801-4353-a386-1f9aaddaea83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:46.499425 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dc7d0176-8801-4353-a386-1f9aaddaea83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:46.500256 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dc7d0176-8801-4353-a386-1f9aaddaea83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:46.500743 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dc7d0176-8801-4353-a386-1f9aaddaea83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:46.643200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-173a8ff1-f506-4d26-b061-ac07c9ffbee3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:46.643866 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-173a8ff1-f506-4d26-b061-ac07c9ffbee3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:46.652316 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-173a8ff1-f506-4d26-b061-ac07c9ffbee3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:46.652819 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-173a8ff1-f506-4d26-b061-ac07c9ffbee3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:46.653671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-173a8ff1-f506-4d26-b061-ac07c9ffbee3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:46.654198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-173a8ff1-f506-4d26-b061-ac07c9ffbee3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:46.714156 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dc7d0176-8801-4353-a386-1f9aaddaea83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:46.723863 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-dc7d0176-8801-4353-a386-1f9aaddaea83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.238082 Feb 17 03:28:46.724458 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 106/199] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:46 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:46.865059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-173a8ff1-f506-4d26-b061-ac07c9ffbee3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:46.874766 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-173a8ff1-f506-4d26-b061-ac07c9ffbee3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.235604 Feb 17 03:28:46.875458 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 94/200] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:46 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:47.189168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5db9862d-6567-454f-bb49-45742bf00b10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:47.189775 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5db9862d-6567-454f-bb49-45742bf00b10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:47.197740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5db9862d-6567-454f-bb49-45742bf00b10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:47.198240 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5db9862d-6567-454f-bb49-45742bf00b10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:47.199056 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5db9862d-6567-454f-bb49-45742bf00b10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:47.199540 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5db9862d-6567-454f-bb49-45742bf00b10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:47.335953 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-91f7a921-bbbd-4436-be14-cb4b7b206572 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:47.336623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-91f7a921-bbbd-4436-be14-cb4b7b206572 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:47.344509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-91f7a921-bbbd-4436-be14-cb4b7b206572 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:47.345041 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-91f7a921-bbbd-4436-be14-cb4b7b206572 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:47.345939 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-91f7a921-bbbd-4436-be14-cb4b7b206572 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:47.346411 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-91f7a921-bbbd-4436-be14-cb4b7b206572 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:47.407580 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5db9862d-6567-454f-bb49-45742bf00b10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:47.417683 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5db9862d-6567-454f-bb49-45742bf00b10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:47.419272 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5db9862d-6567-454f-bb49-45742bf00b10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:47.420409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5db9862d-6567-454f-bb49-45742bf00b10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.235360 Feb 17 03:28:47.420993 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 107/201] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:47 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:47.556659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-91f7a921-bbbd-4436-be14-cb4b7b206572 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:47.566135 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-91f7a921-bbbd-4436-be14-cb4b7b206572 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1551 microversion: 2.1 time: 0.234121 Feb 17 03:28:47.566727 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 95/202] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:47 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1551 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:47.741837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ea2f5360-1bbc-4c23-9ffa-187a4653934f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:47.742502 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ea2f5360-1bbc-4c23-9ffa-187a4653934f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:47.750218 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea2f5360-1bbc-4c23-9ffa-187a4653934f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:47.750724 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea2f5360-1bbc-4c23-9ffa-187a4653934f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:47.751555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea2f5360-1bbc-4c23-9ffa-187a4653934f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:47.752044 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea2f5360-1bbc-4c23-9ffa-187a4653934f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:47.893335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-db8d2bf9-aaa7-49d4-91a2-41fd04a05590 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:47.894064 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-db8d2bf9-aaa7-49d4-91a2-41fd04a05590 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:47.902437 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-db8d2bf9-aaa7-49d4-91a2-41fd04a05590 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:47.902947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-db8d2bf9-aaa7-49d4-91a2-41fd04a05590 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:47.903785 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-db8d2bf9-aaa7-49d4-91a2-41fd04a05590 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:47.904271 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-db8d2bf9-aaa7-49d4-91a2-41fd04a05590 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:47.998897 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ea2f5360-1bbc-4c23-9ffa-187a4653934f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:48.015766 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ea2f5360-1bbc-4c23-9ffa-187a4653934f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.277742 Feb 17 03:28:48.017118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 108/203] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:47 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:48.126120 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-db8d2bf9-aaa7-49d4-91a2-41fd04a05590 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:48.135335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-db8d2bf9-aaa7-49d4-91a2-41fd04a05590 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.246051 Feb 17 03:28:48.135923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 96/204] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:47 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:48.440094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-308c1176-7e26-420c-afe5-2c0e62c9b3ff tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:48.440706 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-308c1176-7e26-420c-afe5-2c0e62c9b3ff tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:48.449326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-308c1176-7e26-420c-afe5-2c0e62c9b3ff tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:48.449822 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-308c1176-7e26-420c-afe5-2c0e62c9b3ff tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:48.450641 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-308c1176-7e26-420c-afe5-2c0e62c9b3ff tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:48.451119 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-308c1176-7e26-420c-afe5-2c0e62c9b3ff tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:48.584373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3a23406b-a002-4b0d-9210-fec3e0c94f8e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:48.585019 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3a23406b-a002-4b0d-9210-fec3e0c94f8e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:48.592730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3a23406b-a002-4b0d-9210-fec3e0c94f8e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:48.593266 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3a23406b-a002-4b0d-9210-fec3e0c94f8e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:48.594088 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3a23406b-a002-4b0d-9210-fec3e0c94f8e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:48.594974 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3a23406b-a002-4b0d-9210-fec3e0c94f8e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:48.657292 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-308c1176-7e26-420c-afe5-2c0e62c9b3ff tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:48.667145 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-308c1176-7e26-420c-afe5-2c0e62c9b3ff tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:48.668737 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-308c1176-7e26-420c-afe5-2c0e62c9b3ff tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:48.669894 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-308c1176-7e26-420c-afe5-2c0e62c9b3ff tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.234036 Feb 17 03:28:48.670477 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 109/205] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:48 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:48.801696 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3a23406b-a002-4b0d-9210-fec3e0c94f8e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:48.811700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3a23406b-a002-4b0d-9210-fec3e0c94f8e tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1551 microversion: 2.1 time: 0.231363 Feb 17 03:28:48.812291 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 97/206] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:48 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1551 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:49.034676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ea2bfc75-775e-47da-aa4b-f549a487f484 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:49.035324 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ea2bfc75-775e-47da-aa4b-f549a487f484 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:49.043745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea2bfc75-775e-47da-aa4b-f549a487f484 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:49.044253 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea2bfc75-775e-47da-aa4b-f549a487f484 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:49.045100 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea2bfc75-775e-47da-aa4b-f549a487f484 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:49.045597 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea2bfc75-775e-47da-aa4b-f549a487f484 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:49.153671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e35f35e1-1f44-4c24-8c1e-70396bd1f4eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:49.154370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e35f35e1-1f44-4c24-8c1e-70396bd1f4eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:49.162196 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e35f35e1-1f44-4c24-8c1e-70396bd1f4eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:49.162679 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e35f35e1-1f44-4c24-8c1e-70396bd1f4eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:49.163671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e35f35e1-1f44-4c24-8c1e-70396bd1f4eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:49.164305 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e35f35e1-1f44-4c24-8c1e-70396bd1f4eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:49.260027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ea2bfc75-775e-47da-aa4b-f549a487f484 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:49.269387 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ea2bfc75-775e-47da-aa4b-f549a487f484 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.238758 Feb 17 03:28:49.270173 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 110/207] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:49 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:49.379083 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e35f35e1-1f44-4c24-8c1e-70396bd1f4eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:49.388189 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e35f35e1-1f44-4c24-8c1e-70396bd1f4eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.239157 Feb 17 03:28:49.388799 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 98/208] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:49 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:49.689806 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ef54542a-35fc-4162-9a36-102d4f5d41ca tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:49.690607 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ef54542a-35fc-4162-9a36-102d4f5d41ca tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:49.699468 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef54542a-35fc-4162-9a36-102d4f5d41ca tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:49.699970 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef54542a-35fc-4162-9a36-102d4f5d41ca tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:49.700848 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef54542a-35fc-4162-9a36-102d4f5d41ca tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:49.701366 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef54542a-35fc-4162-9a36-102d4f5d41ca tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:49.830815 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e76072a7-5a38-466e-ad6f-6189f36cc9e9 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:49.831494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e76072a7-5a38-466e-ad6f-6189f36cc9e9 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:49.839857 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e76072a7-5a38-466e-ad6f-6189f36cc9e9 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:49.840365 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e76072a7-5a38-466e-ad6f-6189f36cc9e9 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:49.841230 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e76072a7-5a38-466e-ad6f-6189f36cc9e9 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:49.841725 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e76072a7-5a38-466e-ad6f-6189f36cc9e9 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:49.948482 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ef54542a-35fc-4162-9a36-102d4f5d41ca tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:49.958543 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ef54542a-35fc-4162-9a36-102d4f5d41ca tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:49.960237 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ef54542a-35fc-4162-9a36-102d4f5d41ca tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:49.961417 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ef54542a-35fc-4162-9a36-102d4f5d41ca tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.275634 Feb 17 03:28:49.962033 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 111/209] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:49 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:50.193377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e76072a7-5a38-466e-ad6f-6189f36cc9e9 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:50.203225 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e76072a7-5a38-466e-ad6f-6189f36cc9e9 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1551 microversion: 2.1 time: 0.376967 Feb 17 03:28:50.203765 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 99/210] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:49 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1551 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:50.287627 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1f49a8ab-56f0-45e3-8b5a-02fbe85d6237 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:50.288290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1f49a8ab-56f0-45e3-8b5a-02fbe85d6237 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:50.296581 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1f49a8ab-56f0-45e3-8b5a-02fbe85d6237 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:50.297115 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1f49a8ab-56f0-45e3-8b5a-02fbe85d6237 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:50.297953 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1f49a8ab-56f0-45e3-8b5a-02fbe85d6237 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:50.298445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1f49a8ab-56f0-45e3-8b5a-02fbe85d6237 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:50.406121 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3e2c8a15-daea-4fb3-a73d-0716f1aaead8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:50.406653 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3e2c8a15-daea-4fb3-a73d-0716f1aaead8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:50.415236 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3e2c8a15-daea-4fb3-a73d-0716f1aaead8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:50.415752 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3e2c8a15-daea-4fb3-a73d-0716f1aaead8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:50.416595 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3e2c8a15-daea-4fb3-a73d-0716f1aaead8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:50.417094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3e2c8a15-daea-4fb3-a73d-0716f1aaead8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:50.507072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1f49a8ab-56f0-45e3-8b5a-02fbe85d6237 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:50.515952 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1f49a8ab-56f0-45e3-8b5a-02fbe85d6237 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.232335 Feb 17 03:28:50.516541 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 112/211] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:50 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:50.622977 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3e2c8a15-daea-4fb3-a73d-0716f1aaead8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:50.631619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3e2c8a15-daea-4fb3-a73d-0716f1aaead8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.229622 Feb 17 03:28:50.632208 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 100/212] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:50 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:50.980034 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-52a97a18-d5d4-4900-a21c-13437e1e308b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:50.980705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-52a97a18-d5d4-4900-a21c-13437e1e308b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:50.988697 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-52a97a18-d5d4-4900-a21c-13437e1e308b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:50.989251 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-52a97a18-d5d4-4900-a21c-13437e1e308b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:50.990091 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-52a97a18-d5d4-4900-a21c-13437e1e308b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:50.990584 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-52a97a18-d5d4-4900-a21c-13437e1e308b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:51.205107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-52a97a18-d5d4-4900-a21c-13437e1e308b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:51.214941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-52a97a18-d5d4-4900-a21c-13437e1e308b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:51.216510 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-52a97a18-d5d4-4900-a21c-13437e1e308b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:51.217682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-52a97a18-d5d4-4900-a21c-13437e1e308b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.241835 Feb 17 03:28:51.218249 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 113/213] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:50 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:51.221119 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c36ad93e-effd-4d2d-b3f8-9b3c25ab3bac tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:51.221786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c36ad93e-effd-4d2d-b3f8-9b3c25ab3bac tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:51.229529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c36ad93e-effd-4d2d-b3f8-9b3c25ab3bac tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:51.230029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c36ad93e-effd-4d2d-b3f8-9b3c25ab3bac tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:51.230862 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c36ad93e-effd-4d2d-b3f8-9b3c25ab3bac tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:51.231348 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c36ad93e-effd-4d2d-b3f8-9b3c25ab3bac tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:51.444716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c36ad93e-effd-4d2d-b3f8-9b3c25ab3bac tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:51.454760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c36ad93e-effd-4d2d-b3f8-9b3c25ab3bac tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1551 microversion: 2.1 time: 0.237600 Feb 17 03:28:51.455344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 101/214] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:51 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1551 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:51.534349 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-aec70657-dfda-4c5c-aed6-3ab680689e6d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:51.534938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-aec70657-dfda-4c5c-aed6-3ab680689e6d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:51.542620 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aec70657-dfda-4c5c-aed6-3ab680689e6d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:51.543145 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aec70657-dfda-4c5c-aed6-3ab680689e6d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:51.543988 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aec70657-dfda-4c5c-aed6-3ab680689e6d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:51.544473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aec70657-dfda-4c5c-aed6-3ab680689e6d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:51.649798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a9b651f8-614a-460c-94f2-3d203210ef44 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:51.650376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a9b651f8-614a-460c-94f2-3d203210ef44 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:51.658137 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a9b651f8-614a-460c-94f2-3d203210ef44 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:51.658639 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a9b651f8-614a-460c-94f2-3d203210ef44 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:51.659467 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a9b651f8-614a-460c-94f2-3d203210ef44 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:51.659950 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a9b651f8-614a-460c-94f2-3d203210ef44 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:51.755346 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-aec70657-dfda-4c5c-aed6-3ab680689e6d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:51.764330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-aec70657-dfda-4c5c-aed6-3ab680689e6d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.234016 Feb 17 03:28:51.764917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 114/215] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:51 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:51.870395 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a9b651f8-614a-460c-94f2-3d203210ef44 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:51.879299 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a9b651f8-614a-460c-94f2-3d203210ef44 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.233654 Feb 17 03:28:51.880089 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 102/216] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:51 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:52.235801 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-073af398-558e-489b-8c39-303711176a10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:52.236469 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-073af398-558e-489b-8c39-303711176a10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:52.244389 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-073af398-558e-489b-8c39-303711176a10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:52.244892 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-073af398-558e-489b-8c39-303711176a10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:52.245820 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-073af398-558e-489b-8c39-303711176a10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:52.246315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-073af398-558e-489b-8c39-303711176a10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:52.471972 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-eba88aeb-99c1-4d36-bbfc-cdf6c749a2d0 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:52.472630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-eba88aeb-99c1-4d36-bbfc-cdf6c749a2d0 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:52.479623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-073af398-558e-489b-8c39-303711176a10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:52.488052 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eba88aeb-99c1-4d36-bbfc-cdf6c749a2d0 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:52.488582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eba88aeb-99c1-4d36-bbfc-cdf6c749a2d0 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:52.489476 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eba88aeb-99c1-4d36-bbfc-cdf6c749a2d0 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:52.489998 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eba88aeb-99c1-4d36-bbfc-cdf6c749a2d0 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:52.490586 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-073af398-558e-489b-8c39-303711176a10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:52.492192 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-073af398-558e-489b-8c39-303711176a10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:52.493438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-073af398-558e-489b-8c39-303711176a10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 0.261590 Feb 17 03:28:52.494318 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 115/217] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:52 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:52.732606 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-eba88aeb-99c1-4d36-bbfc-cdf6c749a2d0 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:52.742066 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-eba88aeb-99c1-4d36-bbfc-cdf6c749a2d0 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1551 microversion: 2.1 time: 0.274023 Feb 17 03:28:52.742660 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 103/218] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:52 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1551 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:52.765544 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-e5116639-f1d4-4af5-9f53-79d216540653 req-bf48f6ae-d5a5-405f-9ebe-a2441d0b24e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5a8ede-8248-460e-bef7-6b5c3aaf48f5", "name": "network-vif-plugged", "status": "completed", "tag": "48fb65e6-ad21-424b-ad45-8e4c51055da6"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:52.767326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:52.767326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:28:52.777004 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-e5116639-f1d4-4af5-9f53-79d216540653 req-bf48f6ae-d5a5-405f-9ebe-a2441d0b24e1 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:52.777770 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-e5116639-f1d4-4af5-9f53-79d216540653 req-bf48f6ae-d5a5-405f-9ebe-a2441d0b24e1 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:52.782381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-be8b5345-f0ee-45ea-8777-2dedc728cecf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:52.783050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-be8b5345-f0ee-45ea-8777-2dedc728cecf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:52.790982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be8b5345-f0ee-45ea-8777-2dedc728cecf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:52.791487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be8b5345-f0ee-45ea-8777-2dedc728cecf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:52.792328 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be8b5345-f0ee-45ea-8777-2dedc728cecf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:52.792817 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be8b5345-f0ee-45ea-8777-2dedc728cecf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:52.796104 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-e5116639-f1d4-4af5-9f53-79d216540653 req-bf48f6ae-d5a5-405f-9ebe-a2441d0b24e1 service nova] Creating event network-vif-plugged:48fb65e6-ad21-424b-ad45-8e4c51055da6 for instance 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 on hv-cinder-75994 Feb 17 03:28:52.801325 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-e5116639-f1d4-4af5-9f53-79d216540653 req-bf48f6ae-d5a5-405f-9ebe-a2441d0b24e1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039559 Feb 17 03:28:52.802212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 116/219] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:52.898932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9e906379-dd8d-41d6-847d-2a5f01239855 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:52.899884 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9e906379-dd8d-41d6-847d-2a5f01239855 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:52.908294 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9e906379-dd8d-41d6-847d-2a5f01239855 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:52.908793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9e906379-dd8d-41d6-847d-2a5f01239855 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:52.909706 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9e906379-dd8d-41d6-847d-2a5f01239855 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:52.910337 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9e906379-dd8d-41d6-847d-2a5f01239855 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:53.013454 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-be8b5345-f0ee-45ea-8777-2dedc728cecf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:53.022366 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-be8b5345-f0ee-45ea-8777-2dedc728cecf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.244055 Feb 17 03:28:53.022936 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 104/220] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:52 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:53.191307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9e906379-dd8d-41d6-847d-2a5f01239855 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:53.201636 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9e906379-dd8d-41d6-847d-2a5f01239855 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.307343 Feb 17 03:28:53.202929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 117/221] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:52 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:28:53.236740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c9d04e4a-fae7-4a5d-bb2b-173a8060065d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-801997392", "imageRef": "27891a64-31b3-4754-87b4-bf609a12c59a", "flavorRef": "452", "networks": [{"uuid": "8d611967-ac3b-4d3e-854e-ff34ac61dc4a"}]}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:53.319340 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-c9d04e4a-fae7-4a5d-bb2b-173a8060065d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] validate_networks() for [('8d611967-ac3b-4d3e-854e-ff34ac61dc4a', None, None, None)] {{(pid=98103) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:28:53.515645 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-13f02bbd-9f42-465d-97b9-25d9e26aa9ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:53.517643 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-13f02bbd-9f42-465d-97b9-25d9e26aa9ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:53.538392 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-13f02bbd-9f42-465d-97b9-25d9e26aa9ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:53.538896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-13f02bbd-9f42-465d-97b9-25d9e26aa9ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:53.540386 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-13f02bbd-9f42-465d-97b9-25d9e26aa9ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:53.540883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-13f02bbd-9f42-465d-97b9-25d9e26aa9ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:54.033641 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-c9d04e4a-fae7-4a5d-bb2b-173a8060065d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:28:54.034049 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-c9d04e4a-fae7-4a5d-bb2b-173a8060065d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:28:54.034597 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-c9d04e4a-fae7-4a5d-bb2b-173a8060065d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:28:54.035372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-c9d04e4a-fae7-4a5d-bb2b-173a8060065d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:28:54.035852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-c9d04e4a-fae7-4a5d-bb2b-173a8060065d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:28:54.052745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c9d04e4a-fae7-4a5d-bb2b-173a8060065d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:54.053366 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c9d04e4a-fae7-4a5d-bb2b-173a8060065d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:54.054595 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c9d04e4a-fae7-4a5d-bb2b-173a8060065d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:54.055101 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c9d04e4a-fae7-4a5d-bb2b-173a8060065d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:54.089200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-c9d04e4a-fae7-4a5d-bb2b-173a8060065d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Getting quotas for project 90b33b201e9c4aaa92ca566c8f7e6dac. Resources: {'ram', 'cores', 'instances'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:28:54.094341 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-c9d04e4a-fae7-4a5d-bb2b-173a8060065d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Getting quotas for user 03ffe03f3f7040418e36d56834cbb18e and project 90b33b201e9c4aaa92ca566c8f7e6dac. Resources: {'ram', 'cores', 'instances'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:28:54.109949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c9d04e4a-fae7-4a5d-bb2b-173a8060065d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Going to run 1 instances... {{(pid=98103) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:28:54.112674 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c9d04e4a-fae7-4a5d-bb2b-173a8060065d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27891a64-31b3-4754-87b4-bf609a12c59a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:28:54.180564 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c9d04e4a-fae7-4a5d-bb2b-173a8060065d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949119 Feb 17 03:28:54.186712 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 105/222] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:28:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:28:54.186712 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-34a9b281-549b-4db5-a57e-517372b855d8 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:54.187380 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-34a9b281-549b-4db5-a57e-517372b855d8 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:54.198143 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34a9b281-549b-4db5-a57e-517372b855d8 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:54.198668 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34a9b281-549b-4db5-a57e-517372b855d8 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:54.199543 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34a9b281-549b-4db5-a57e-517372b855d8 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:54.200039 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34a9b281-549b-4db5-a57e-517372b855d8 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:54.543175 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-13f02bbd-9f42-465d-97b9-25d9e26aa9ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:54.557400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-13f02bbd-9f42-465d-97b9-25d9e26aa9ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:54.560967 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-13f02bbd-9f42-465d-97b9-25d9e26aa9ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:54.562280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-13f02bbd-9f42-465d-97b9-25d9e26aa9ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1406 microversion: 2.20 time: 1.054276 Feb 17 03:28:54.563092 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 118/223] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:53 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1406 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:54.568180 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-96a911ab-8ea1-4231-99f1-362881ca6df2 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:54.569300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-96a911ab-8ea1-4231-99f1-362881ca6df2 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:54.579412 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-96a911ab-8ea1-4231-99f1-362881ca6df2 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:54.580232 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-96a911ab-8ea1-4231-99f1-362881ca6df2 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:54.581825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-96a911ab-8ea1-4231-99f1-362881ca6df2 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:54.582447 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-96a911ab-8ea1-4231-99f1-362881ca6df2 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:54.635529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-34a9b281-549b-4db5-a57e-517372b855d8 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:54.646307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-34a9b281-549b-4db5-a57e-517372b855d8 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1551 microversion: 2.1 time: 0.463761 Feb 17 03:28:54.646918 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 106/224] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:54 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1551 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:54.659749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9c0e80dd-f58f-47bc-8c7b-0c8d86e4b7e5 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:54.660415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9c0e80dd-f58f-47bc-8c7b-0c8d86e4b7e5 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:54.792545 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9c0e80dd-f58f-47bc-8c7b-0c8d86e4b7e5 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:54.803281 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9c0e80dd-f58f-47bc-8c7b-0c8d86e4b7e5 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1218 microversion: 2.1 time: 0.155259 Feb 17 03:28:54.804154 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 107/225] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:54 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1218 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:54.809645 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-18ab28ab-6b6b-4009-b41a-46c9b9f96fd3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:54.810481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-18ab28ab-6b6b-4009-b41a-46c9b9f96fd3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:54.822983 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-18ab28ab-6b6b-4009-b41a-46c9b9f96fd3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:54.823947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-18ab28ab-6b6b-4009-b41a-46c9b9f96fd3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:54.825222 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-18ab28ab-6b6b-4009-b41a-46c9b9f96fd3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:54.826529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-18ab28ab-6b6b-4009-b41a-46c9b9f96fd3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:54.854344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-96a911ab-8ea1-4231-99f1-362881ca6df2 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:54.877902 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-96a911ab-8ea1-4231-99f1-362881ca6df2 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.313499 Feb 17 03:28:54.878575 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 119/226] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:54 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:54.883451 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-2d39985c-d2e3-469e-af93-0caac9680508 req-5a849302-5c40-4ef7-8f19-b377c88a78a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a792992-ad2a-408d-9e19-9363ed0b0c51", "name": "network-vif-unplugged", "status": "completed", "tag": "8783865b-a078-4448-ad74-449c2887c2a3"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:54.890112 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:54.890112 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:28:54.899615 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-2d39985c-d2e3-469e-af93-0caac9680508 req-5a849302-5c40-4ef7-8f19-b377c88a78a2 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:54.900381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-2d39985c-d2e3-469e-af93-0caac9680508 req-5a849302-5c40-4ef7-8f19-b377c88a78a2 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:54.922984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-2d39985c-d2e3-469e-af93-0caac9680508 req-5a849302-5c40-4ef7-8f19-b377c88a78a2 service nova] Creating event network-vif-unplugged:8783865b-a078-4448-ad74-449c2887c2a3 for instance 5a792992-ad2a-408d-9e19-9363ed0b0c51 on hv-cinder-75994 Feb 17 03:28:54.928461 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-2d39985c-d2e3-469e-af93-0caac9680508 req-5a849302-5c40-4ef7-8f19-b377c88a78a2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048588 Feb 17 03:28:54.929334 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 120/227] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:54 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:55.108813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-18ab28ab-6b6b-4009-b41a-46c9b9f96fd3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:55.109363 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-021531b1-5642-42ff-aded-a09cd2da0eaa tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-962093591", "imageRef": "27891a64-31b3-4754-87b4-bf609a12c59a", "flavorRef": "452", "networks": [{"uuid": "90e5bf38-a0dc-48bd-9401-739bcf8a5d8a"}]}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:55.121932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-18ab28ab-6b6b-4009-b41a-46c9b9f96fd3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1363 microversion: 2.1 time: 0.316479 Feb 17 03:28:55.122735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 108/228] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:54 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:55.187554 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-021531b1-5642-42ff-aded-a09cd2da0eaa tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] validate_networks() for [('90e5bf38-a0dc-48bd-9401-739bcf8a5d8a', None, None, None)] {{(pid=98104) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:28:55.582453 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-868724f9-1973-43b0-8be5-4e75c82aab3f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:55.583037 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-868724f9-1973-43b0-8be5-4e75c82aab3f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:55.591756 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-868724f9-1973-43b0-8be5-4e75c82aab3f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:55.592246 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-868724f9-1973-43b0-8be5-4e75c82aab3f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:55.593117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-868724f9-1973-43b0-8be5-4e75c82aab3f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:55.593833 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-868724f9-1973-43b0-8be5-4e75c82aab3f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:55.849786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-868724f9-1973-43b0-8be5-4e75c82aab3f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:55.865537 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-868724f9-1973-43b0-8be5-4e75c82aab3f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:55.867382 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-868724f9-1973-43b0-8be5-4e75c82aab3f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:55.869365 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-868724f9-1973-43b0-8be5-4e75c82aab3f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1596 microversion: 2.20 time: 0.290970 Feb 17 03:28:55.881799 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 109/229] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:28:55 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1596 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:28:55.891179 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2438e9ea-46c6-4f57-bdf9-0b260a5f5970 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:55.892090 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2438e9ea-46c6-4f57-bdf9-0b260a5f5970 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:55.900197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2438e9ea-46c6-4f57-bdf9-0b260a5f5970 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:55.900933 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2438e9ea-46c6-4f57-bdf9-0b260a5f5970 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:55.902027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2438e9ea-46c6-4f57-bdf9-0b260a5f5970 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:55.902705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2438e9ea-46c6-4f57-bdf9-0b260a5f5970 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.049374 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2438e9ea-46c6-4f57-bdf9-0b260a5f5970 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:56.060622 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2438e9ea-46c6-4f57-bdf9-0b260a5f5970 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1509 microversion: 2.1 time: 0.177420 Feb 17 03:28:56.061432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 110/230] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:55 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:56.066675 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-81963434-8e89-4ee8-a382-64f788644cdb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:56.067334 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-81963434-8e89-4ee8-a382-64f788644cdb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:56.081854 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-81963434-8e89-4ee8-a382-64f788644cdb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:56.082418 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-81963434-8e89-4ee8-a382-64f788644cdb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.083307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-81963434-8e89-4ee8-a382-64f788644cdb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:56.083864 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-81963434-8e89-4ee8-a382-64f788644cdb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.213234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-81963434-8e89-4ee8-a382-64f788644cdb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:56.222955 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-81963434-8e89-4ee8-a382-64f788644cdb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1270 microversion: 2.1 time: 0.160482 Feb 17 03:28:56.232813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 111/231] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:56 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:56.232813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f87c1c0d-7f4f-487a-baef-8202762ff691 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:56.232813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f87c1c0d-7f4f-487a-baef-8202762ff691 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:56.245355 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f87c1c0d-7f4f-487a-baef-8202762ff691 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:56.246117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f87c1c0d-7f4f-487a-baef-8202762ff691 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.247017 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f87c1c0d-7f4f-487a-baef-8202762ff691 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:56.247504 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f87c1c0d-7f4f-487a-baef-8202762ff691 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.370064 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-021531b1-5642-42ff-aded-a09cd2da0eaa tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Flavor limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:28:56.373874 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-021531b1-5642-42ff-aded-a09cd2da0eaa tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Image limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:28:56.374456 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-021531b1-5642-42ff-aded-a09cd2da0eaa tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Flavor pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:28:56.374931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-021531b1-5642-42ff-aded-a09cd2da0eaa tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Image pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:28:56.375986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-021531b1-5642-42ff-aded-a09cd2da0eaa tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:28:56.393659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-021531b1-5642-42ff-aded-a09cd2da0eaa tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:56.394774 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-021531b1-5642-42ff-aded-a09cd2da0eaa tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.395844 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-021531b1-5642-42ff-aded-a09cd2da0eaa tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:56.396357 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-021531b1-5642-42ff-aded-a09cd2da0eaa tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.429165 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-021531b1-5642-42ff-aded-a09cd2da0eaa tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Getting quotas for project 41ae341c7001465897265b1c5eda9767. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:28:56.434709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-021531b1-5642-42ff-aded-a09cd2da0eaa tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Getting quotas for user 4d9f8d95ac0a4a4bb6aad0bbc963d08d and project 41ae341c7001465897265b1c5eda9767. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:28:56.446489 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-021531b1-5642-42ff-aded-a09cd2da0eaa tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Going to run 1 instances... {{(pid=98104) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:28:56.449287 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-021531b1-5642-42ff-aded-a09cd2da0eaa tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27891a64-31b3-4754-87b4-bf609a12c59a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:28:56.509109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-021531b1-5642-42ff-aded-a09cd2da0eaa tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.404356 Feb 17 03:28:56.509801 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 121/232] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:28:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 1406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:28:56.517870 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6471c6f6-aa3e-43a3-ae8b-74ff3f22f16d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:56.518555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6471c6f6-aa3e-43a3-ae8b-74ff3f22f16d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:56.544142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6471c6f6-aa3e-43a3-ae8b-74ff3f22f16d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:56.544540 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6471c6f6-aa3e-43a3-ae8b-74ff3f22f16d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.545664 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6471c6f6-aa3e-43a3-ae8b-74ff3f22f16d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:56.546599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6471c6f6-aa3e-43a3-ae8b-74ff3f22f16d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.560529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f87c1c0d-7f4f-487a-baef-8202762ff691 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.335291 Feb 17 03:28:56.561377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 112/233] 10.222.0.57 () {60 vars in 1306 bytes} [Wed Feb 17 03:28:56 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/os-interface => generated 284 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:28:56.572442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ce6eb5a2-ad58-43d2-92de-7a9ad99baa76 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:56.573130 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ce6eb5a2-ad58-43d2-92de-7a9ad99baa76 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:56.590682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ce6eb5a2-ad58-43d2-92de-7a9ad99baa76 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:56.591191 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ce6eb5a2-ad58-43d2-92de-7a9ad99baa76 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.592023 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ce6eb5a2-ad58-43d2-92de-7a9ad99baa76 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:56.592513 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ce6eb5a2-ad58-43d2-92de-7a9ad99baa76 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:56.996140 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ce6eb5a2-ad58-43d2-92de-7a9ad99baa76 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:57.005187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ce6eb5a2-ad58-43d2-92de-7a9ad99baa76 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1549 microversion: 2.1 time: 0.436835 Feb 17 03:28:57.005790 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 113/234] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:56 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1549 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:57.022209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-e2c24e2a-7fda-4dad-a5db-5cfe07d7bd7a req-d49d5710-935f-4605-87bf-0c4a7dc3e33e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a792992-ad2a-408d-9e19-9363ed0b0c51", "name": "network-vif-deleted", "tag": "8783865b-a078-4448-ad74-449c2887c2a3"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:57.025312 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:28:57.025312 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:28:57.036147 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-e2c24e2a-7fda-4dad-a5db-5cfe07d7bd7a req-d49d5710-935f-4605-87bf-0c4a7dc3e33e service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:57.036912 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-e2c24e2a-7fda-4dad-a5db-5cfe07d7bd7a req-d49d5710-935f-4605-87bf-0c4a7dc3e33e service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:57.055675 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-e2c24e2a-7fda-4dad-a5db-5cfe07d7bd7a req-d49d5710-935f-4605-87bf-0c4a7dc3e33e service nova] Creating event network-vif-deleted:8783865b-a078-4448-ad74-449c2887c2a3 for instance 5a792992-ad2a-408d-9e19-9363ed0b0c51 on hv-cinder-75994 Feb 17 03:28:57.061296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-e2c24e2a-7fda-4dad-a5db-5cfe07d7bd7a req-d49d5710-935f-4605-87bf-0c4a7dc3e33e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054054 Feb 17 03:28:57.061977 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 114/235] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:28:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:57.072421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ae0a2180-56b2-4359-8f82-5735a08aa6fd tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:57.073229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ae0a2180-56b2-4359-8f82-5735a08aa6fd tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:57.083014 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ae0a2180-56b2-4359-8f82-5735a08aa6fd tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:57.083538 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ae0a2180-56b2-4359-8f82-5735a08aa6fd tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:57.084344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ae0a2180-56b2-4359-8f82-5735a08aa6fd tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:57.085304 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ae0a2180-56b2-4359-8f82-5735a08aa6fd tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:57.290470 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ae0a2180-56b2-4359-8f82-5735a08aa6fd tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:57.301770 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ae0a2180-56b2-4359-8f82-5735a08aa6fd tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1221 microversion: 2.1 time: 0.238463 Feb 17 03:28:57.308134 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 115/236] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:57 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1221 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:57.308380 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f4396f2a-8549-4554-96ad-7960d52cf352 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:57.308965 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f4396f2a-8549-4554-96ad-7960d52cf352 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:57.319153 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4396f2a-8549-4554-96ad-7960d52cf352 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:57.319653 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4396f2a-8549-4554-96ad-7960d52cf352 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:57.320518 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4396f2a-8549-4554-96ad-7960d52cf352 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:57.321602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4396f2a-8549-4554-96ad-7960d52cf352 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:57.510959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6471c6f6-aa3e-43a3-ae8b-74ff3f22f16d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:57.520050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6471c6f6-aa3e-43a3-ae8b-74ff3f22f16d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 1.009163 Feb 17 03:28:57.521213 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 122/237] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:56 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:57.526622 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-11c65d60-09d4-4c3e-98ad-7e5744f70001 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:57.527427 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-11c65d60-09d4-4c3e-98ad-7e5744f70001 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:57.541844 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-11c65d60-09d4-4c3e-98ad-7e5744f70001 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:57.542470 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-11c65d60-09d4-4c3e-98ad-7e5744f70001 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:57.544332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-11c65d60-09d4-4c3e-98ad-7e5744f70001 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:57.545694 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-11c65d60-09d4-4c3e-98ad-7e5744f70001 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:57.577180 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f4396f2a-8549-4554-96ad-7960d52cf352 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.273551 Feb 17 03:28:57.585181 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 116/238] 10.222.0.57 () {58 vars in 1265 bytes} [Wed Feb 17 03:28:57 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/os-interface => generated 284 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:28:57.585181 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-42d14fa4-bf13-4f76-b804-39560ba9f286 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:57.585527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-42d14fa4-bf13-4f76-b804-39560ba9f286 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:57.606252 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-42d14fa4-bf13-4f76-b804-39560ba9f286 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:57.606774 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-42d14fa4-bf13-4f76-b804-39560ba9f286 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:57.607602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-42d14fa4-bf13-4f76-b804-39560ba9f286 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:57.608255 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-42d14fa4-bf13-4f76-b804-39560ba9f286 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:57.891867 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-11c65d60-09d4-4c3e-98ad-7e5744f70001 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:57.906096 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-11c65d60-09d4-4c3e-98ad-7e5744f70001 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1346 microversion: 2.1 time: 0.383560 Feb 17 03:28:57.915880 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 123/239] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:57 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1346 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:58.076050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-42d14fa4-bf13-4f76-b804-39560ba9f286 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:58.085775 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-42d14fa4-bf13-4f76-b804-39560ba9f286 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1276 microversion: 2.1 time: 0.505410 Feb 17 03:28:58.086561 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 117/240] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:57 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1276 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:58.320414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f75738ce-553c-4f6e-800e-20fe746bb3a5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:58.321657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f75738ce-553c-4f6e-800e-20fe746bb3a5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:58.329670 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f75738ce-553c-4f6e-800e-20fe746bb3a5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:58.330234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f75738ce-553c-4f6e-800e-20fe746bb3a5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:58.331079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f75738ce-553c-4f6e-800e-20fe746bb3a5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:58.331572 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f75738ce-553c-4f6e-800e-20fe746bb3a5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:58.472183 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f75738ce-553c-4f6e-800e-20fe746bb3a5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:58.482821 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f75738ce-553c-4f6e-800e-20fe746bb3a5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1269 microversion: 2.1 time: 0.166612 Feb 17 03:28:58.483595 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 124/241] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:58 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:58.540116 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-27bac516-8b9e-421d-a266-da0409bd7aa7 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:58.541019 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-27bac516-8b9e-421d-a266-da0409bd7aa7 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:58.549907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-27bac516-8b9e-421d-a266-da0409bd7aa7 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:58.550543 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-27bac516-8b9e-421d-a266-da0409bd7aa7 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:58.551616 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-27bac516-8b9e-421d-a266-da0409bd7aa7 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:58.552214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-27bac516-8b9e-421d-a266-da0409bd7aa7 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:58.924142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-77ef2b7c-42ef-46cb-a3ff-dcd92e0a7b47 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:58.925514 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-77ef2b7c-42ef-46cb-a3ff-dcd92e0a7b47 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:58.935064 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-77ef2b7c-42ef-46cb-a3ff-dcd92e0a7b47 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:58.936200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-77ef2b7c-42ef-46cb-a3ff-dcd92e0a7b47 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:58.937432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-77ef2b7c-42ef-46cb-a3ff-dcd92e0a7b47 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:58.938474 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-77ef2b7c-42ef-46cb-a3ff-dcd92e0a7b47 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:59.079399 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-77ef2b7c-42ef-46cb-a3ff-dcd92e0a7b47 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:59.090378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-77ef2b7c-42ef-46cb-a3ff-dcd92e0a7b47 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1346 microversion: 2.1 time: 0.169653 Feb 17 03:28:59.101188 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 125/242] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:58 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1346 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:59.101188 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9416fdfc-a0e5-435c-af43-2c5e0c980b25 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:28:59.101188 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9416fdfc-a0e5-435c-af43-2c5e0c980b25 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:59.107456 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9416fdfc-a0e5-435c-af43-2c5e0c980b25 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:59.107957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9416fdfc-a0e5-435c-af43-2c5e0c980b25 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:59.108810 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9416fdfc-a0e5-435c-af43-2c5e0c980b25 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:59.109361 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9416fdfc-a0e5-435c-af43-2c5e0c980b25 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:59.377668 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-27bac516-8b9e-421d-a266-da0409bd7aa7 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:28:59.386866 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-27bac516-8b9e-421d-a266-da0409bd7aa7 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.851771 Feb 17 03:28:59.397312 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 118/243] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:58 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:28:59.402572 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a1754019-12e4-4db4-b68d-12251a2e9895 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:28:59.404701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a1754019-12e4-4db4-b68d-12251a2e9895 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:28:59.414460 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1754019-12e4-4db4-b68d-12251a2e9895 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:59.415479 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1754019-12e4-4db4-b68d-12251a2e9895 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:28:59.416353 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1754019-12e4-4db4-b68d-12251a2e9895 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:28:59.416852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1754019-12e4-4db4-b68d-12251a2e9895 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:00.190226 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a1754019-12e4-4db4-b68d-12251a2e9895 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:00.199577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a1754019-12e4-4db4-b68d-12251a2e9895 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1318 microversion: 2.1 time: 0.801193 Feb 17 03:29:00.209862 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 119/244] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:28:59 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1318 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:00.215165 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-8272f700-a7fc-41f0-97e8-22c1b3c7fff0 req-92c1fe77-5a0e-498c-948a-33bc3403358a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4840bec6-59fa-4a75-9cab-b8eba3fced9d", "tag": "3122eba0-b4d4-415e-b7c0-f67223c6ab3f"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:00.216927 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:29:00.216927 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:29:00.225988 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-8272f700-a7fc-41f0-97e8-22c1b3c7fff0 req-92c1fe77-5a0e-498c-948a-33bc3403358a service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:00.226490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-8272f700-a7fc-41f0-97e8-22c1b3c7fff0 req-92c1fe77-5a0e-498c-948a-33bc3403358a service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:00.245063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-8272f700-a7fc-41f0-97e8-22c1b3c7fff0 req-92c1fe77-5a0e-498c-948a-33bc3403358a service nova] Creating event network-changed:3122eba0-b4d4-415e-b7c0-f67223c6ab3f for instance 4840bec6-59fa-4a75-9cab-b8eba3fced9d on hv-cinder-75994 Feb 17 03:29:00.250273 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-8272f700-a7fc-41f0-97e8-22c1b3c7fff0 req-92c1fe77-5a0e-498c-948a-33bc3403358a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048076 Feb 17 03:29:00.251079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 120/245] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:29:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:29:00.256606 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3bf89902-ef23-4506-804b-dd0eb683bba4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:00.257810 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3bf89902-ef23-4506-804b-dd0eb683bba4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:00.265913 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3bf89902-ef23-4506-804b-dd0eb683bba4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:00.266421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3bf89902-ef23-4506-804b-dd0eb683bba4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:00.267281 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3bf89902-ef23-4506-804b-dd0eb683bba4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:00.267776 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3bf89902-ef23-4506-804b-dd0eb683bba4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:00.442011 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3bf89902-ef23-4506-804b-dd0eb683bba4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:00.451107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3bf89902-ef23-4506-804b-dd0eb683bba4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1269 microversion: 2.1 time: 0.198810 Feb 17 03:29:00.451898 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 121/246] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:00 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1269 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:00.456415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f0b3fad0-09ec-4e8c-a9ac-a2629ec4d01c tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:00.457088 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f0b3fad0-09ec-4e8c-a9ac-a2629ec4d01c tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:00.465229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f0b3fad0-09ec-4e8c-a9ac-a2629ec4d01c tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:00.465737 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f0b3fad0-09ec-4e8c-a9ac-a2629ec4d01c tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:00.466574 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f0b3fad0-09ec-4e8c-a9ac-a2629ec4d01c tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:00.467061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f0b3fad0-09ec-4e8c-a9ac-a2629ec4d01c tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:00.615125 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f0b3fad0-09ec-4e8c-a9ac-a2629ec4d01c tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:00.637141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f0b3fad0-09ec-4e8c-a9ac-a2629ec4d01c tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1346 microversion: 2.1 time: 0.184271 Feb 17 03:29:00.647035 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 122/247] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:00 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1346 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:00.647035 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-93d69574-451a-46b0-965f-e9949609d2ec tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:00.647035 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-93d69574-451a-46b0-965f-e9949609d2ec tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:00.652480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-93d69574-451a-46b0-965f-e9949609d2ec tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:00.652991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-93d69574-451a-46b0-965f-e9949609d2ec tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:00.653885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-93d69574-451a-46b0-965f-e9949609d2ec tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:00.654375 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-93d69574-451a-46b0-965f-e9949609d2ec tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:00.869412 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-93d69574-451a-46b0-965f-e9949609d2ec tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:00.878207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-93d69574-451a-46b0-965f-e9949609d2ec tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.239093 Feb 17 03:29:00.889236 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 123/248] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:00 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:00.894397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8f385217-e46f-4207-a36a-ff7338160a27 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:00.895491 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8f385217-e46f-4207-a36a-ff7338160a27 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:00.904145 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f385217-e46f-4207-a36a-ff7338160a27 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:00.904717 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f385217-e46f-4207-a36a-ff7338160a27 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:00.905490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f385217-e46f-4207-a36a-ff7338160a27 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:00.905986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f385217-e46f-4207-a36a-ff7338160a27 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:02.126979 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9416fdfc-a0e5-435c-af43-2c5e0c980b25 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 14 microversion: 2.20 time: 3.033648 Feb 17 03:29:02.131311 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 126/249] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:28:59 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 14 bytes in 3039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:02.135947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8f385217-e46f-4207-a36a-ff7338160a27 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 14 microversion: 2.1 time: 1.245207 Feb 17 03:29:02.139583 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 124/250] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:00 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 14 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:29:02.139727 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-37fef092-3f91-4f40-883f-9581e64c6cec req-a4f8b4ac-430d-4974-97bc-7cf948a8b185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c5a8ede-8248-460e-bef7-6b5c3aaf48f5", "tag": "48fb65e6-ad21-424b-ad45-8e4c51055da6"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:02.139825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:29:02.139825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:29:02.141949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-64d38984-16a4-4378-b309-9f75ced0de7d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:02.142717 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-64d38984-16a4-4378-b309-9f75ced0de7d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:02.159282 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-37fef092-3f91-4f40-883f-9581e64c6cec req-a4f8b4ac-430d-4974-97bc-7cf948a8b185 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:02.159903 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-37fef092-3f91-4f40-883f-9581e64c6cec req-a4f8b4ac-430d-4974-97bc-7cf948a8b185 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:02.162873 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-64d38984-16a4-4378-b309-9f75ced0de7d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:02.163682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-64d38984-16a4-4378-b309-9f75ced0de7d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:02.164237 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-64d38984-16a4-4378-b309-9f75ced0de7d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:02.164827 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-64d38984-16a4-4378-b309-9f75ced0de7d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:02.180553 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-37fef092-3f91-4f40-883f-9581e64c6cec req-a4f8b4ac-430d-4974-97bc-7cf948a8b185 service nova] Creating event network-changed:48fb65e6-ad21-424b-ad45-8e4c51055da6 for instance 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 on hv-cinder-75994 Feb 17 03:29:02.186247 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-37fef092-3f91-4f40-883f-9581e64c6cec req-a4f8b4ac-430d-4974-97bc-7cf948a8b185 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053340 Feb 17 03:29:02.187273 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 127/251] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:29:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:29:02.196541 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-790d0b44-40da-4989-8d0d-781615798fd0 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:02.197631 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-790d0b44-40da-4989-8d0d-781615798fd0 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:02.207090 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-790d0b44-40da-4989-8d0d-781615798fd0 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:02.207701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-790d0b44-40da-4989-8d0d-781615798fd0 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:02.208632 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-790d0b44-40da-4989-8d0d-781615798fd0 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:02.209236 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-790d0b44-40da-4989-8d0d-781615798fd0 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:02.605776 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-64d38984-16a4-4378-b309-9f75ced0de7d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:02.619389 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-64d38984-16a4-4378-b309-9f75ced0de7d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1318 microversion: 2.1 time: 0.481370 Feb 17 03:29:02.620025 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 125/252] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:02 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:02.624954 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a7a54100-d3bc-4490-86d8-d1609096b914 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:02.627834 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a7a54100-d3bc-4490-86d8-d1609096b914 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:02.643793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a7a54100-d3bc-4490-86d8-d1609096b914 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:02.644326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a7a54100-d3bc-4490-86d8-d1609096b914 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:02.645220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a7a54100-d3bc-4490-86d8-d1609096b914 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:02.645715 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a7a54100-d3bc-4490-86d8-d1609096b914 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:02.841625 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-790d0b44-40da-4989-8d0d-781615798fd0 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:02.854828 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-790d0b44-40da-4989-8d0d-781615798fd0 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1269 microversion: 2.1 time: 0.666147 Feb 17 03:29:02.861104 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 128/253] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:02 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1269 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:02.872141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-67cca596-0421-4510-bb28-06c77872dcef tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:02.873209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-67cca596-0421-4510-bb28-06c77872dcef tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:02.882577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-67cca596-0421-4510-bb28-06c77872dcef tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:02.883469 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-67cca596-0421-4510-bb28-06c77872dcef tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:02.884661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-67cca596-0421-4510-bb28-06c77872dcef tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:02.885383 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-67cca596-0421-4510-bb28-06c77872dcef tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:02.937420 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a7a54100-d3bc-4490-86d8-d1609096b914 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04bc2f7bc7dc45f9a4b4c31ccc52599d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26d86e30e4e473798e908122de8a6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:02.955142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a7a54100-d3bc-4490-86d8-d1609096b914 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 200 len: 1346 microversion: 2.1 time: 0.333802 Feb 17 03:29:02.956142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 126/254] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:02 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 1346 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:03.139310 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-127a4d88-33ee-4c2f-bf0f-2cc73883fcc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:03.141059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-127a4d88-33ee-4c2f-bf0f-2cc73883fcc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:03.149133 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-127a4d88-33ee-4c2f-bf0f-2cc73883fcc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:03.149909 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-127a4d88-33ee-4c2f-bf0f-2cc73883fcc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:03.150960 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-127a4d88-33ee-4c2f-bf0f-2cc73883fcc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:03.151640 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-127a4d88-33ee-4c2f-bf0f-2cc73883fcc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:03.305468 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-127a4d88-33ee-4c2f-bf0f-2cc73883fcc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 14 microversion: 2.20 time: 0.169064 Feb 17 03:29:03.307381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 127/255] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:03 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:03.316209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1d1890ba-f609-4976-85df-5ddd6eb8b3cc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:03.317730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1d1890ba-f609-4976-85df-5ddd6eb8b3cc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:03.337911 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1d1890ba-f609-4976-85df-5ddd6eb8b3cc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:03.338420 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1d1890ba-f609-4976-85df-5ddd6eb8b3cc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:03.339273 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1d1890ba-f609-4976-85df-5ddd6eb8b3cc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:03.339768 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1d1890ba-f609-4976-85df-5ddd6eb8b3cc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:03.494966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1d1890ba-f609-4976-85df-5ddd6eb8b3cc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 14 microversion: 2.1 time: 0.185745 Feb 17 03:29:03.501790 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 128/256] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:03 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:29:03.639756 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7f48fd1f-0adc-4f10-9825-abc76ea86a57 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:03.640528 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7f48fd1f-0adc-4f10-9825-abc76ea86a57 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:03.650544 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f48fd1f-0adc-4f10-9825-abc76ea86a57 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:03.650974 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f48fd1f-0adc-4f10-9825-abc76ea86a57 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:03.652184 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f48fd1f-0adc-4f10-9825-abc76ea86a57 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:03.652890 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f48fd1f-0adc-4f10-9825-abc76ea86a57 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:03.879650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-67cca596-0421-4510-bb28-06c77872dcef tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:03.893613 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-67cca596-0421-4510-bb28-06c77872dcef tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 1.031170 Feb 17 03:29:03.894238 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 129/257] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:02 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:03.903877 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3467b4a0-7ae3-4136-aaac-dc93850a44fb tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:03.905697 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3467b4a0-7ae3-4136-aaac-dc93850a44fb tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:03.927163 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3467b4a0-7ae3-4136-aaac-dc93850a44fb tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:03.927949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3467b4a0-7ae3-4136-aaac-dc93850a44fb tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:03.932787 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3467b4a0-7ae3-4136-aaac-dc93850a44fb tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:03.933472 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3467b4a0-7ae3-4136-aaac-dc93850a44fb tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:04.310540 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3467b4a0-7ae3-4136-aaac-dc93850a44fb tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:04.334704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3467b4a0-7ae3-4136-aaac-dc93850a44fb tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1275 microversion: 2.1 time: 0.438615 Feb 17 03:29:04.335559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 130/258] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:03 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1275 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:04.354035 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-da15efcb-db6b-4168-96e9-55a52eb95239 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:04.358662 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-da15efcb-db6b-4168-96e9-55a52eb95239 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:04.376608 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da15efcb-db6b-4168-96e9-55a52eb95239 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:04.377192 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da15efcb-db6b-4168-96e9-55a52eb95239 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:04.378050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da15efcb-db6b-4168-96e9-55a52eb95239 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:04.378723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da15efcb-db6b-4168-96e9-55a52eb95239 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:04.452300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-da15efcb-db6b-4168-96e9-55a52eb95239 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] HTTP exception thrown: Instance 5a792992-ad2a-408d-9e19-9363ed0b0c51 could not be found. Feb 17 03:29:04.453102 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-da15efcb-db6b-4168-96e9-55a52eb95239 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Returning 404 to user: Instance 5a792992-ad2a-408d-9e19-9363ed0b0c51 could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:29:04.454205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-da15efcb-db6b-4168-96e9-55a52eb95239 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 404 len: 111 microversion: 2.1 time: 0.111317 Feb 17 03:29:04.454894 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 131/259] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:04 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:29:04.460101 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-253c6e41-0004-49ec-8156-f454393f42c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:04.462062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-253c6e41-0004-49ec-8156-f454393f42c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:04.471202 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-253c6e41-0004-49ec-8156-f454393f42c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:04.471919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-253c6e41-0004-49ec-8156-f454393f42c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:04.472950 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-253c6e41-0004-49ec-8156-f454393f42c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:04.473784 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-253c6e41-0004-49ec-8156-f454393f42c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:04.499284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7f48fd1f-0adc-4f10-9825-abc76ea86a57 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:04.513410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7f48fd1f-0adc-4f10-9825-abc76ea86a57 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1318 microversion: 2.1 time: 0.879785 Feb 17 03:29:04.524669 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 129/260] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:03 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1318 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:04.532108 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-bc9362eb-f709-4b70-8b82-213a0d003c50 req-fc3bb111-bf5e-4bd9-86f6-5b68b64e89e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "affa2e6b-a2e1-47dc-9593-14492775c963", "tag": "e0b1164b-a521-406c-ad35-9ec6820de4cc"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:04.533817 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:29:04.533817 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:29:04.553205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-bc9362eb-f709-4b70-8b82-213a0d003c50 req-fc3bb111-bf5e-4bd9-86f6-5b68b64e89e2 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:04.553820 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-bc9362eb-f709-4b70-8b82-213a0d003c50 req-fc3bb111-bf5e-4bd9-86f6-5b68b64e89e2 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:04.576046 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-bc9362eb-f709-4b70-8b82-213a0d003c50 req-fc3bb111-bf5e-4bd9-86f6-5b68b64e89e2 service nova] Creating event network-changed:e0b1164b-a521-406c-ad35-9ec6820de4cc for instance affa2e6b-a2e1-47dc-9593-14492775c963 on hv-cinder-75994 Feb 17 03:29:04.583373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-bc9362eb-f709-4b70-8b82-213a0d003c50 req-fc3bb111-bf5e-4bd9-86f6-5b68b64e89e2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057267 Feb 17 03:29:04.585300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 130/261] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:29:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:29:04.597003 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c648ee2d-a794-4af1-af2b-f26302369b22 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:04.599503 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c648ee2d-a794-4af1-af2b-f26302369b22 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:04.615119 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c648ee2d-a794-4af1-af2b-f26302369b22 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:04.615637 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c648ee2d-a794-4af1-af2b-f26302369b22 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:04.616793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c648ee2d-a794-4af1-af2b-f26302369b22 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:04.618068 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c648ee2d-a794-4af1-af2b-f26302369b22 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:04.661313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-253c6e41-0004-49ec-8156-f454393f42c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 14 microversion: 2.20 time: 0.204650 Feb 17 03:29:04.666857 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 132/262] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:04 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 14 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:04.780458 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c648ee2d-a794-4af1-af2b-f26302369b22 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 14 microversion: 2.1 time: 0.191651 Feb 17 03:29:04.785684 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 131/263] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:04 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 14 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:29:04.912409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-318a007e-da5d-4dd2-ab8a-f5474a780b81 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:04.913449 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-318a007e-da5d-4dd2-ab8a-f5474a780b81 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:04.922522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-318a007e-da5d-4dd2-ab8a-f5474a780b81 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:04.923327 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-318a007e-da5d-4dd2-ab8a-f5474a780b81 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:04.924426 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-318a007e-da5d-4dd2-ab8a-f5474a780b81 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:04.925060 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-318a007e-da5d-4dd2-ab8a-f5474a780b81 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:05.355299 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9b1e90a6-f976-4b99-8b93-340bfc367a70 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:05.356168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9b1e90a6-f976-4b99-8b93-340bfc367a70 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:05.365217 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9b1e90a6-f976-4b99-8b93-340bfc367a70 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:05.365726 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9b1e90a6-f976-4b99-8b93-340bfc367a70 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:05.366584 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9b1e90a6-f976-4b99-8b93-340bfc367a70 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:05.367073 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9b1e90a6-f976-4b99-8b93-340bfc367a70 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:05.504855 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9b1e90a6-f976-4b99-8b93-340bfc367a70 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:05.514713 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9b1e90a6-f976-4b99-8b93-340bfc367a70 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1275 microversion: 2.1 time: 0.164313 Feb 17 03:29:05.515305 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 132/264] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:05 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:05.535802 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3849f9b5-e4ce-42a6-862a-fa915edf27df tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:05.536466 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3849f9b5-e4ce-42a6-862a-fa915edf27df tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:05.545068 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3849f9b5-e4ce-42a6-862a-fa915edf27df tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:05.545597 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3849f9b5-e4ce-42a6-862a-fa915edf27df tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:05.546454 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3849f9b5-e4ce-42a6-862a-fa915edf27df tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:05.546922 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3849f9b5-e4ce-42a6-862a-fa915edf27df tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:05.767519 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3849f9b5-e4ce-42a6-862a-fa915edf27df tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:05.776926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3849f9b5-e4ce-42a6-862a-fa915edf27df tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1318 microversion: 2.1 time: 0.245006 Feb 17 03:29:05.777777 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 133/265] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:05 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:05.787490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-318a007e-da5d-4dd2-ab8a-f5474a780b81 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:05.792490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b87913fa-60de-44ac-86a1-fdc8255dce17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:05.793589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b87913fa-60de-44ac-86a1-fdc8255dce17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:05.797622 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-318a007e-da5d-4dd2-ab8a-f5474a780b81 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.889765 Feb 17 03:29:05.808620 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 133/266] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:04 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:05.808841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b87913fa-60de-44ac-86a1-fdc8255dce17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:05.808841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b87913fa-60de-44ac-86a1-fdc8255dce17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:05.808841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b87913fa-60de-44ac-86a1-fdc8255dce17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:05.808841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b87913fa-60de-44ac-86a1-fdc8255dce17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:05.809220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e77fcdb6-eace-4219-a108-99dac43db133 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:05.809220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e77fcdb6-eace-4219-a108-99dac43db133 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:05.813348 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e77fcdb6-eace-4219-a108-99dac43db133 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:05.813985 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e77fcdb6-eace-4219-a108-99dac43db133 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:05.814912 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e77fcdb6-eace-4219-a108-99dac43db133 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:05.815483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e77fcdb6-eace-4219-a108-99dac43db133 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:06.032773 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b87913fa-60de-44ac-86a1-fdc8255dce17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 14 microversion: 2.20 time: 0.244395 Feb 17 03:29:06.036468 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 134/267] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:05 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 14 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:06.074522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e77fcdb6-eace-4219-a108-99dac43db133 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 14 microversion: 2.1 time: 0.274678 Feb 17 03:29:06.078300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 134/268] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:05 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 14 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:29:06.165761 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-672fb613-9bc6-4736-b51b-a6b44c7ae283 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:06.166412 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-672fb613-9bc6-4736-b51b-a6b44c7ae283 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:06.175343 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-672fb613-9bc6-4736-b51b-a6b44c7ae283 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:06.175855 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-672fb613-9bc6-4736-b51b-a6b44c7ae283 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:06.176706 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-672fb613-9bc6-4736-b51b-a6b44c7ae283 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:06.177227 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-672fb613-9bc6-4736-b51b-a6b44c7ae283 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:06.234057 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-672fb613-9bc6-4736-b51b-a6b44c7ae283 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] HTTP exception thrown: Instance 5a792992-ad2a-408d-9e19-9363ed0b0c51 could not be found. Feb 17 03:29:06.234738 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-672fb613-9bc6-4736-b51b-a6b44c7ae283 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Returning 404 to user: Instance 5a792992-ad2a-408d-9e19-9363ed0b0c51 could not be found. {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:29:06.235644 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-672fb613-9bc6-4736-b51b-a6b44c7ae283 tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 404 len: 111 microversion: 2.1 time: 0.074440 Feb 17 03:29:06.236534 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 135/269] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:29:06 2021] DELETE /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:29:06.249294 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ade79adb-8731-4946-b348-343d77c20bca tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:06.250084 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ade79adb-8731-4946-b348-343d77c20bca tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] [instance: 5a792992-ad2a-408d-9e19-9363ed0b0c51] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:06.259586 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ade79adb-8731-4946-b348-343d77c20bca tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:06.260313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ade79adb-8731-4946-b348-343d77c20bca tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:06.261156 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ade79adb-8731-4946-b348-343d77c20bca tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:06.261815 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ade79adb-8731-4946-b348-343d77c20bca tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:06.332653 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-ade79adb-8731-4946-b348-343d77c20bca tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] HTTP exception thrown: Instance 5a792992-ad2a-408d-9e19-9363ed0b0c51 could not be found. Feb 17 03:29:06.333551 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ade79adb-8731-4946-b348-343d77c20bca tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] Returning 404 to user: Instance 5a792992-ad2a-408d-9e19-9363ed0b0c51 could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:29:06.334563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ade79adb-8731-4946-b348-343d77c20bca tempest-DeleteServersTestJSON-594113530 tempest-DeleteServersTestJSON-594113530-project] 10.222.0.57 "GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51" status: 404 len: 111 microversion: 2.1 time: 0.092887 Feb 17 03:29:06.335297 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 135/270] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:06 2021] GET /compute/v2.1/servers/5a792992-ad2a-408d-9e19-9363ed0b0c51 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:29:06.533384 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6b6489fc-0239-42c3-afce-2b879354416b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:06.534418 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6b6489fc-0239-42c3-afce-2b879354416b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:06.543105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6b6489fc-0239-42c3-afce-2b879354416b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:06.543731 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6b6489fc-0239-42c3-afce-2b879354416b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:06.544816 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6b6489fc-0239-42c3-afce-2b879354416b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:06.545747 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6b6489fc-0239-42c3-afce-2b879354416b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:06.794956 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b7699de2-f228-4bec-af0d-10182cb782d6 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:06.795597 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b7699de2-f228-4bec-af0d-10182cb782d6 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:06.811105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b7699de2-f228-4bec-af0d-10182cb782d6 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:06.812391 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b7699de2-f228-4bec-af0d-10182cb782d6 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:06.814815 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b7699de2-f228-4bec-af0d-10182cb782d6 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:06.815894 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b7699de2-f228-4bec-af0d-10182cb782d6 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:07.025957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6b6489fc-0239-42c3-afce-2b879354416b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:07.035032 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6b6489fc-0239-42c3-afce-2b879354416b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1317 microversion: 2.1 time: 0.506044 Feb 17 03:29:07.035937 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 136/271] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:06 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:07.043448 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-36e86844-cd34-4d6f-97bf-991843900575 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:07.044368 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-36e86844-cd34-4d6f-97bf-991843900575 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:07.052269 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-36e86844-cd34-4d6f-97bf-991843900575 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:07.052755 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-36e86844-cd34-4d6f-97bf-991843900575 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:07.054268 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-36e86844-cd34-4d6f-97bf-991843900575 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:07.054769 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-36e86844-cd34-4d6f-97bf-991843900575 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:07.655029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-36e86844-cd34-4d6f-97bf-991843900575 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:07.667552 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-36e86844-cd34-4d6f-97bf-991843900575 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.630066 Feb 17 03:29:07.669165 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 137/272] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:07 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:07.675194 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6160e6d5-c3b5-4416-80eb-7a6bc08fb3c3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:07.676821 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6160e6d5-c3b5-4416-80eb-7a6bc08fb3c3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:07.687537 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6160e6d5-c3b5-4416-80eb-7a6bc08fb3c3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:07.688602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6160e6d5-c3b5-4416-80eb-7a6bc08fb3c3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:07.689824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6160e6d5-c3b5-4416-80eb-7a6bc08fb3c3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:07.690504 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6160e6d5-c3b5-4416-80eb-7a6bc08fb3c3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:07.703343 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b7699de2-f228-4bec-af0d-10182cb782d6 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:07.716925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b7699de2-f228-4bec-af0d-10182cb782d6 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1318 microversion: 2.1 time: 0.926020 Feb 17 03:29:07.720062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 136/273] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:06 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1318 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:07.735731 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a0b3da7e-ba7f-4720-9f30-8fbf4ff77c0d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:07.737492 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a0b3da7e-ba7f-4720-9f30-8fbf4ff77c0d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:07.802125 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a0b3da7e-ba7f-4720-9f30-8fbf4ff77c0d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:07.804871 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a0b3da7e-ba7f-4720-9f30-8fbf4ff77c0d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:07.806523 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a0b3da7e-ba7f-4720-9f30-8fbf4ff77c0d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:07.807388 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a0b3da7e-ba7f-4720-9f30-8fbf4ff77c0d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:07.948426 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6160e6d5-c3b5-4416-80eb-7a6bc08fb3c3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 14 microversion: 2.20 time: 0.277629 Feb 17 03:29:07.949422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 138/274] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:07 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 14 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:07.979201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a0b3da7e-ba7f-4720-9f30-8fbf4ff77c0d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 14 microversion: 2.1 time: 0.253407 Feb 17 03:29:07.983147 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 137/275] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:07 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 14 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:29:08.054239 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-dce52f58-7224-413c-b7ef-657416f65ebe tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:08.055705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-dce52f58-7224-413c-b7ef-657416f65ebe tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:08.068284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dce52f58-7224-413c-b7ef-657416f65ebe tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:08.068914 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dce52f58-7224-413c-b7ef-657416f65ebe tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:08.069900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dce52f58-7224-413c-b7ef-657416f65ebe tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:08.070394 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dce52f58-7224-413c-b7ef-657416f65ebe tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:08.655025 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-c9f174f0-f9bc-408c-9094-23719815b62b req-516b18cd-2f91-4b46-b74c-f6130ccf5eac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fbbd236-7b97-4182-8fe1-acbc901bf34e", "tag": "3f278c60-d4fc-48d2-a84d-a1bd008033aa"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:08.656693 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:29:08.656693 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:29:08.687438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-c9f174f0-f9bc-408c-9094-23719815b62b req-516b18cd-2f91-4b46-b74c-f6130ccf5eac service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:08.693427 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-c9f174f0-f9bc-408c-9094-23719815b62b req-516b18cd-2f91-4b46-b74c-f6130ccf5eac service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:08.743298 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-c9f174f0-f9bc-408c-9094-23719815b62b req-516b18cd-2f91-4b46-b74c-f6130ccf5eac service nova] Creating event network-changed:3f278c60-d4fc-48d2-a84d-a1bd008033aa for instance 4fbbd236-7b97-4182-8fe1-acbc901bf34e on hv-cinder-75994 Feb 17 03:29:08.751474 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-c9f174f0-f9bc-408c-9094-23719815b62b req-516b18cd-2f91-4b46-b74c-f6130ccf5eac service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101278 Feb 17 03:29:08.756555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 138/276] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:29:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:29:08.768245 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8aacebe6-3f1d-40b2-9432-eeca8d824f11 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:08.771001 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8aacebe6-3f1d-40b2-9432-eeca8d824f11 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:08.792065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8aacebe6-3f1d-40b2-9432-eeca8d824f11 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:08.792568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8aacebe6-3f1d-40b2-9432-eeca8d824f11 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:08.795364 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8aacebe6-3f1d-40b2-9432-eeca8d824f11 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:08.797319 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8aacebe6-3f1d-40b2-9432-eeca8d824f11 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:08.918613 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dce52f58-7224-413c-b7ef-657416f65ebe tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:08.933336 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-dce52f58-7224-413c-b7ef-657416f65ebe tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1317 microversion: 2.1 time: 0.883420 Feb 17 03:29:08.934439 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 139/277] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:08 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1317 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:08.939843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bb879e54-68ed-45ae-92cc-0d1d4c5951bd tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:08.940503 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bb879e54-68ed-45ae-92cc-0d1d4c5951bd tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:08.949478 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb879e54-68ed-45ae-92cc-0d1d4c5951bd tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:08.949940 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb879e54-68ed-45ae-92cc-0d1d4c5951bd tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:08.950945 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb879e54-68ed-45ae-92cc-0d1d4c5951bd tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:08.951759 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb879e54-68ed-45ae-92cc-0d1d4c5951bd tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:09.262923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bb879e54-68ed-45ae-92cc-0d1d4c5951bd tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:09.276394 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bb879e54-68ed-45ae-92cc-0d1d4c5951bd tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1318 microversion: 2.1 time: 0.339653 Feb 17 03:29:09.278040 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 140/278] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:08 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:09.300031 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6a5236e6-4441-4951-bdac-5676a5f5435b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:09.301919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6a5236e6-4441-4951-bdac-5676a5f5435b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:09.312080 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6a5236e6-4441-4951-bdac-5676a5f5435b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:09.312759 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6a5236e6-4441-4951-bdac-5676a5f5435b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:09.313846 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6a5236e6-4441-4951-bdac-5676a5f5435b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:09.314826 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6a5236e6-4441-4951-bdac-5676a5f5435b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:09.371177 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8aacebe6-3f1d-40b2-9432-eeca8d824f11 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:09.384174 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8aacebe6-3f1d-40b2-9432-eeca8d824f11 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.624171 Feb 17 03:29:09.394183 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 139/279] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:08 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:09.401878 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c1e84748-2001-4bd6-9a94-5b9368877570 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:09.402815 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c1e84748-2001-4bd6-9a94-5b9368877570 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:09.427483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c1e84748-2001-4bd6-9a94-5b9368877570 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:09.428000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c1e84748-2001-4bd6-9a94-5b9368877570 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:09.428867 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c1e84748-2001-4bd6-9a94-5b9368877570 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:09.429359 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c1e84748-2001-4bd6-9a94-5b9368877570 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:09.550253 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6a5236e6-4441-4951-bdac-5676a5f5435b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 14 microversion: 2.20 time: 0.260451 Feb 17 03:29:09.552612 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 141/280] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:09 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 14 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:09.768470 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c1e84748-2001-4bd6-9a94-5b9368877570 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 14 microversion: 2.1 time: 0.372805 Feb 17 03:29:09.769318 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 140/281] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:09 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 14 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:29:09.952862 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-83c4796f-6961-455b-931a-dde8e9b67556 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:09.953562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-83c4796f-6961-455b-931a-dde8e9b67556 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:09.962616 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-83c4796f-6961-455b-931a-dde8e9b67556 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:09.963122 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-83c4796f-6961-455b-931a-dde8e9b67556 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:09.964074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-83c4796f-6961-455b-931a-dde8e9b67556 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:09.964687 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-83c4796f-6961-455b-931a-dde8e9b67556 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:10.224466 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-83c4796f-6961-455b-931a-dde8e9b67556 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:10.234171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-83c4796f-6961-455b-931a-dde8e9b67556 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1317 microversion: 2.1 time: 0.286015 Feb 17 03:29:10.235430 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 142/282] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:09 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:10.297461 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-79c24b39-6d66-42e8-a04e-7fb3d6b8d884 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:10.298650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-79c24b39-6d66-42e8-a04e-7fb3d6b8d884 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:10.314507 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-79c24b39-6d66-42e8-a04e-7fb3d6b8d884 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:10.315756 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-79c24b39-6d66-42e8-a04e-7fb3d6b8d884 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:10.317328 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-79c24b39-6d66-42e8-a04e-7fb3d6b8d884 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:10.318099 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-79c24b39-6d66-42e8-a04e-7fb3d6b8d884 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:10.401079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-805ca749-3fa0-41a3-95f4-25da1ff86f43 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:10.401784 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-805ca749-3fa0-41a3-95f4-25da1ff86f43 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:10.412443 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-805ca749-3fa0-41a3-95f4-25da1ff86f43 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:10.412945 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-805ca749-3fa0-41a3-95f4-25da1ff86f43 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:10.413808 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-805ca749-3fa0-41a3-95f4-25da1ff86f43 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:10.418354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-805ca749-3fa0-41a3-95f4-25da1ff86f43 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:10.903463 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-79c24b39-6d66-42e8-a04e-7fb3d6b8d884 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:10.919256 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-79c24b39-6d66-42e8-a04e-7fb3d6b8d884 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1318 microversion: 2.1 time: 0.627527 Feb 17 03:29:10.920233 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 141/283] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:10 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1318 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:10.928031 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-75108a37-f9aa-4a03-a4a6-ac0b2c86b39f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:10.930026 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-75108a37-f9aa-4a03-a4a6-ac0b2c86b39f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:10.942282 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-805ca749-3fa0-41a3-95f4-25da1ff86f43 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:10.957001 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-805ca749-3fa0-41a3-95f4-25da1ff86f43 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.559894 Feb 17 03:29:10.957602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 143/284] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:10 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:10.968110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-75108a37-f9aa-4a03-a4a6-ac0b2c86b39f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:10.968110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-75108a37-f9aa-4a03-a4a6-ac0b2c86b39f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:10.968110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-75108a37-f9aa-4a03-a4a6-ac0b2c86b39f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:10.968110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-75108a37-f9aa-4a03-a4a6-ac0b2c86b39f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:10.977874 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6e742fab-b803-42c9-85f3-075f9425af8f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:10.991283 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6e742fab-b803-42c9-85f3-075f9425af8f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:11.017703 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e742fab-b803-42c9-85f3-075f9425af8f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:11.018276 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e742fab-b803-42c9-85f3-075f9425af8f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:11.019338 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e742fab-b803-42c9-85f3-075f9425af8f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:11.019902 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e742fab-b803-42c9-85f3-075f9425af8f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:11.172228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-75108a37-f9aa-4a03-a4a6-ac0b2c86b39f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 6451 microversion: 2.20 time: 0.250095 Feb 17 03:29:11.173340 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 142/285] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:10 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 6451 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:29:11.208472 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6e742fab-b803-42c9-85f3-075f9425af8f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 14 microversion: 2.1 time: 0.236698 Feb 17 03:29:11.209593 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 144/286] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:10 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 14 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:29:11.255356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5fbf3520-9d4c-4e48-b5fd-c252df0eef9e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:11.256788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5fbf3520-9d4c-4e48-b5fd-c252df0eef9e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:11.268632 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5fbf3520-9d4c-4e48-b5fd-c252df0eef9e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:11.269315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5fbf3520-9d4c-4e48-b5fd-c252df0eef9e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:11.270177 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5fbf3520-9d4c-4e48-b5fd-c252df0eef9e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:11.270690 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5fbf3520-9d4c-4e48-b5fd-c252df0eef9e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:11.542870 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5fbf3520-9d4c-4e48-b5fd-c252df0eef9e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:11.559029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5fbf3520-9d4c-4e48-b5fd-c252df0eef9e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1317 microversion: 2.1 time: 0.310072 Feb 17 03:29:11.559689 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 143/287] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:11 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:11.942119 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-53674b69-1acd-421c-be6f-4a176f1bb2fb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:11.942898 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-53674b69-1acd-421c-be6f-4a176f1bb2fb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:11.952346 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-53674b69-1acd-421c-be6f-4a176f1bb2fb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:11.952856 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-53674b69-1acd-421c-be6f-4a176f1bb2fb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:11.953719 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-53674b69-1acd-421c-be6f-4a176f1bb2fb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:11.954385 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-53674b69-1acd-421c-be6f-4a176f1bb2fb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:11.975791 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-235e480c-6860-4092-aa7b-f95b45f8f5b4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:11.976458 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-235e480c-6860-4092-aa7b-f95b45f8f5b4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:11.993916 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-235e480c-6860-4092-aa7b-f95b45f8f5b4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:11.994563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-235e480c-6860-4092-aa7b-f95b45f8f5b4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:11.995151 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-235e480c-6860-4092-aa7b-f95b45f8f5b4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:11.995638 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-235e480c-6860-4092-aa7b-f95b45f8f5b4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:12.240315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-53674b69-1acd-421c-be6f-4a176f1bb2fb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:12.259177 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-53674b69-1acd-421c-be6f-4a176f1bb2fb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1318 microversion: 2.1 time: 0.312426 Feb 17 03:29:12.259177 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 145/288] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:11 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:12.262630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a6340504-6c6e-4348-afe0-b3d957141b95 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:12.263860 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a6340504-6c6e-4348-afe0-b3d957141b95 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:12.272062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a6340504-6c6e-4348-afe0-b3d957141b95 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:12.272578 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a6340504-6c6e-4348-afe0-b3d957141b95 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:12.273485 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a6340504-6c6e-4348-afe0-b3d957141b95 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:12.274063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a6340504-6c6e-4348-afe0-b3d957141b95 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:12.401933 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-235e480c-6860-4092-aa7b-f95b45f8f5b4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:12.412318 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-235e480c-6860-4092-aa7b-f95b45f8f5b4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.440435 Feb 17 03:29:12.424264 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 144/289] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:11 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:12.430787 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1d52ec5d-c6dd-462c-a6fa-0adeba12db3c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:12.432146 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1d52ec5d-c6dd-462c-a6fa-0adeba12db3c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:12.434212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a6340504-6c6e-4348-afe0-b3d957141b95 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 12971 microversion: 2.20 time: 0.182593 Feb 17 03:29:12.436739 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 146/290] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:12 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 12971 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:12.442210 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1d52ec5d-c6dd-462c-a6fa-0adeba12db3c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:12.442723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1d52ec5d-c6dd-462c-a6fa-0adeba12db3c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:12.443898 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1d52ec5d-c6dd-462c-a6fa-0adeba12db3c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:12.444590 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1d52ec5d-c6dd-462c-a6fa-0adeba12db3c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:12.579074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9f85a8fa-c27b-4fd9-a3c7-aa6a9ed8b8e6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:12.579858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9f85a8fa-c27b-4fd9-a3c7-aa6a9ed8b8e6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:12.588734 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9f85a8fa-c27b-4fd9-a3c7-aa6a9ed8b8e6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:12.589105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9f85a8fa-c27b-4fd9-a3c7-aa6a9ed8b8e6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:12.589960 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9f85a8fa-c27b-4fd9-a3c7-aa6a9ed8b8e6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:12.590450 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9f85a8fa-c27b-4fd9-a3c7-aa6a9ed8b8e6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:12.594976 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1d52ec5d-c6dd-462c-a6fa-0adeba12db3c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 7111 microversion: 2.1 time: 0.168306 Feb 17 03:29:12.601659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 145/291] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:12 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 7111 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:12.690912 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-d01ae6a2-25fe-4324-92f1-78f7f4873d5f req-f523e05e-be95-4bc3-920e-f0c942ac9e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "affa2e6b-a2e1-47dc-9593-14492775c963", "name": "network-vif-plugged", "status": "completed", "tag": "e0b1164b-a521-406c-ad35-9ec6820de4cc"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:12.692568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:29:12.692568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:29:12.702589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-d01ae6a2-25fe-4324-92f1-78f7f4873d5f req-f523e05e-be95-4bc3-920e-f0c942ac9e34 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:12.703095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-d01ae6a2-25fe-4324-92f1-78f7f4873d5f req-f523e05e-be95-4bc3-920e-f0c942ac9e34 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:12.724339 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-d01ae6a2-25fe-4324-92f1-78f7f4873d5f req-f523e05e-be95-4bc3-920e-f0c942ac9e34 service nova] Creating event network-vif-plugged:e0b1164b-a521-406c-ad35-9ec6820de4cc for instance affa2e6b-a2e1-47dc-9593-14492775c963 on hv-cinder-75994 Feb 17 03:29:12.730075 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-d01ae6a2-25fe-4324-92f1-78f7f4873d5f req-f523e05e-be95-4bc3-920e-f0c942ac9e34 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043653 Feb 17 03:29:12.730998 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 146/292] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:29:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:29:12.856238 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9f85a8fa-c27b-4fd9-a3c7-aa6a9ed8b8e6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:12.869490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9f85a8fa-c27b-4fd9-a3c7-aa6a9ed8b8e6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1317 microversion: 2.1 time: 0.294954 Feb 17 03:29:12.870350 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 147/293] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:12 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:13.268932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8af66fea-5993-4f46-ad6a-c1f29210ba90 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:13.269812 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8af66fea-5993-4f46-ad6a-c1f29210ba90 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:13.278058 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8af66fea-5993-4f46-ad6a-c1f29210ba90 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:13.278771 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8af66fea-5993-4f46-ad6a-c1f29210ba90 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:13.279712 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8af66fea-5993-4f46-ad6a-c1f29210ba90 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:13.280279 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8af66fea-5993-4f46-ad6a-c1f29210ba90 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:13.430827 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d56ae1d8-df07-4fb6-9f34-e37705003af3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:13.431853 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d56ae1d8-df07-4fb6-9f34-e37705003af3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:13.439902 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d56ae1d8-df07-4fb6-9f34-e37705003af3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:13.440729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d56ae1d8-df07-4fb6-9f34-e37705003af3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:13.441844 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d56ae1d8-df07-4fb6-9f34-e37705003af3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:13.442403 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d56ae1d8-df07-4fb6-9f34-e37705003af3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:13.718990 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d56ae1d8-df07-4fb6-9f34-e37705003af3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:13.728563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d56ae1d8-df07-4fb6-9f34-e37705003af3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.302199 Feb 17 03:29:13.729201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 148/294] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:13 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:13.734256 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bdd92c6f-da66-47f4-9a2d-1a86b60983a1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:13.735444 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bdd92c6f-da66-47f4-9a2d-1a86b60983a1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:13.743962 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bdd92c6f-da66-47f4-9a2d-1a86b60983a1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:13.744101 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bdd92c6f-da66-47f4-9a2d-1a86b60983a1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:13.744961 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bdd92c6f-da66-47f4-9a2d-1a86b60983a1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:13.745677 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bdd92c6f-da66-47f4-9a2d-1a86b60983a1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:13.751812 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8af66fea-5993-4f46-ad6a-c1f29210ba90 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:13.763293 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8af66fea-5993-4f46-ad6a-c1f29210ba90 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1318 microversion: 2.1 time: 0.499129 Feb 17 03:29:13.764062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 147/295] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:13 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:13.770160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b8d53ea3-048e-446f-be0c-304f8dc36cf9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:13.771202 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b8d53ea3-048e-446f-be0c-304f8dc36cf9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:13.784305 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b8d53ea3-048e-446f-be0c-304f8dc36cf9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:13.784813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b8d53ea3-048e-446f-be0c-304f8dc36cf9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:13.785792 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b8d53ea3-048e-446f-be0c-304f8dc36cf9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:13.786292 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b8d53ea3-048e-446f-be0c-304f8dc36cf9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:14.041160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b8d53ea3-048e-446f-be0c-304f8dc36cf9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 15025 microversion: 2.1 time: 0.275438 Feb 17 03:29:14.045070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 148/296] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:13 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 15025 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:14.047537 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d0660159-607a-4df9-b03a-47b91437d72b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:14.048293 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d0660159-607a-4df9-b03a-47b91437d72b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:14.057167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d0660159-607a-4df9-b03a-47b91437d72b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:14.057680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d0660159-607a-4df9-b03a-47b91437d72b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:14.058509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d0660159-607a-4df9-b03a-47b91437d72b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:14.059020 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d0660159-607a-4df9-b03a-47b91437d72b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:14.071602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bdd92c6f-da66-47f4-9a2d-1a86b60983a1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 18013 microversion: 2.20 time: 0.340151 Feb 17 03:29:14.072613 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 149/297] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:13 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 18013 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:14.287498 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d0660159-607a-4df9-b03a-47b91437d72b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:14.296721 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d0660159-607a-4df9-b03a-47b91437d72b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1317 microversion: 2.1 time: 0.253633 Feb 17 03:29:14.297381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 149/298] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:14 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:14.746484 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bb34b200-5e7b-4b99-be6d-fbd4431100bd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:14.747261 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bb34b200-5e7b-4b99-be6d-fbd4431100bd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:14.756007 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb34b200-5e7b-4b99-be6d-fbd4431100bd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:14.756525 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb34b200-5e7b-4b99-be6d-fbd4431100bd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:14.757405 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb34b200-5e7b-4b99-be6d-fbd4431100bd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:14.757990 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb34b200-5e7b-4b99-be6d-fbd4431100bd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:14.781661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a094b7d0-3357-482f-a019-c3f1fe91f5a1 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:14.782379 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a094b7d0-3357-482f-a019-c3f1fe91f5a1 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:14.790975 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a094b7d0-3357-482f-a019-c3f1fe91f5a1 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:14.791482 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a094b7d0-3357-482f-a019-c3f1fe91f5a1 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:14.792333 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a094b7d0-3357-482f-a019-c3f1fe91f5a1 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:14.792825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a094b7d0-3357-482f-a019-c3f1fe91f5a1 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:15.004098 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bb34b200-5e7b-4b99-be6d-fbd4431100bd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:15.013884 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bb34b200-5e7b-4b99-be6d-fbd4431100bd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.271833 Feb 17 03:29:15.014482 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 150/299] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:14 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:15.039027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a094b7d0-3357-482f-a019-c3f1fe91f5a1 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:15.049472 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a094b7d0-3357-482f-a019-c3f1fe91f5a1 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1318 microversion: 2.1 time: 0.271239 Feb 17 03:29:15.053292 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-033cbefc-fe9f-4727-a398-cd3b75ac32e1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:15.054375 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-033cbefc-fe9f-4727-a398-cd3b75ac32e1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:15.054502 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 150/300] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:14 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:15.062132 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-033cbefc-fe9f-4727-a398-cd3b75ac32e1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:15.062647 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-033cbefc-fe9f-4727-a398-cd3b75ac32e1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:15.063561 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-033cbefc-fe9f-4727-a398-cd3b75ac32e1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:15.063982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-033cbefc-fe9f-4727-a398-cd3b75ac32e1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:15.084435 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0ebe5b3a-7b50-48ff-8e7b-3893982e7d24 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:15.085607 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0ebe5b3a-7b50-48ff-8e7b-3893982e7d24 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:15.095298 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0ebe5b3a-7b50-48ff-8e7b-3893982e7d24 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:15.096512 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0ebe5b3a-7b50-48ff-8e7b-3893982e7d24 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:15.096660 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0ebe5b3a-7b50-48ff-8e7b-3893982e7d24 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:15.097153 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0ebe5b3a-7b50-48ff-8e7b-3893982e7d24 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:15.337582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-033cbefc-fe9f-4727-a398-cd3b75ac32e1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 17744 microversion: 2.1 time: 0.288110 Feb 17 03:29:15.339529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 151/301] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:15 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 17744 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:15.344502 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e42fab0c-e81c-4e54-b8f0-1f40ff1ab664 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:15.345397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e42fab0c-e81c-4e54-b8f0-1f40ff1ab664 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:15.354675 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e42fab0c-e81c-4e54-b8f0-1f40ff1ab664 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:15.355189 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e42fab0c-e81c-4e54-b8f0-1f40ff1ab664 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:15.356031 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e42fab0c-e81c-4e54-b8f0-1f40ff1ab664 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:15.356529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e42fab0c-e81c-4e54-b8f0-1f40ff1ab664 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:15.543122 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0ebe5b3a-7b50-48ff-8e7b-3893982e7d24 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 19024 microversion: 2.20 time: 0.462825 Feb 17 03:29:15.547032 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 151/302] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:15 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 19024 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:15.587245 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e42fab0c-e81c-4e54-b8f0-1f40ff1ab664 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:15.596477 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e42fab0c-e81c-4e54-b8f0-1f40ff1ab664 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1317 microversion: 2.1 time: 0.256293 Feb 17 03:29:15.597094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 152/303] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:15 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:16.035672 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9a0fae9c-ebf4-4224-a719-429723232bef tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:16.036561 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9a0fae9c-ebf4-4224-a719-429723232bef tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:16.046045 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a0fae9c-ebf4-4224-a719-429723232bef tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:16.046925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a0fae9c-ebf4-4224-a719-429723232bef tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:16.047395 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a0fae9c-ebf4-4224-a719-429723232bef tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:16.047883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a0fae9c-ebf4-4224-a719-429723232bef tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:16.068506 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ba873a72-4ab4-48fb-a22a-78bc4f72684d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:16.069664 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ba873a72-4ab4-48fb-a22a-78bc4f72684d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:16.083186 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ba873a72-4ab4-48fb-a22a-78bc4f72684d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:16.084054 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ba873a72-4ab4-48fb-a22a-78bc4f72684d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:16.085243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ba873a72-4ab4-48fb-a22a-78bc4f72684d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:16.087153 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ba873a72-4ab4-48fb-a22a-78bc4f72684d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:16.325957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9a0fae9c-ebf4-4224-a719-429723232bef tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:16.326590 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ba873a72-4ab4-48fb-a22a-78bc4f72684d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:16.335217 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9a0fae9c-ebf4-4224-a719-429723232bef tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.304392 Feb 17 03:29:16.335409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ba873a72-4ab4-48fb-a22a-78bc4f72684d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1506 microversion: 2.1 time: 0.272033 Feb 17 03:29:16.336225 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 153/304] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:16 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:16.336365 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 152/305] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:16 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:16.350583 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-30c6895f-968e-418a-896b-707418a94c58 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:16.352327 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-30c6895f-968e-418a-896b-707418a94c58 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:16.360895 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30c6895f-968e-418a-896b-707418a94c58 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:16.361452 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30c6895f-968e-418a-896b-707418a94c58 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:16.362347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30c6895f-968e-418a-896b-707418a94c58 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:16.362831 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30c6895f-968e-418a-896b-707418a94c58 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:16.510818 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-30c6895f-968e-418a-896b-707418a94c58 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 18109 microversion: 2.1 time: 0.164076 Feb 17 03:29:16.512168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 154/306] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:16 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 18109 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:29:16.555753 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c58dc3bb-a2e7-4a3f-9c44-eaf530590958 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:16.556891 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c58dc3bb-a2e7-4a3f-9c44-eaf530590958 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:16.565460 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c58dc3bb-a2e7-4a3f-9c44-eaf530590958 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:16.566055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c58dc3bb-a2e7-4a3f-9c44-eaf530590958 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:16.567111 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c58dc3bb-a2e7-4a3f-9c44-eaf530590958 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:16.567617 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c58dc3bb-a2e7-4a3f-9c44-eaf530590958 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:16.617110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-252bdc43-b698-4f86-bc31-d516322377fe tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:16.618834 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-252bdc43-b698-4f86-bc31-d516322377fe tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:16.629911 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-252bdc43-b698-4f86-bc31-d516322377fe tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:16.630594 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-252bdc43-b698-4f86-bc31-d516322377fe tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:16.631653 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-252bdc43-b698-4f86-bc31-d516322377fe tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:16.632628 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-252bdc43-b698-4f86-bc31-d516322377fe tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:16.749261 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c58dc3bb-a2e7-4a3f-9c44-eaf530590958 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 20985 microversion: 2.20 time: 0.197666 Feb 17 03:29:16.750406 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 153/307] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:16 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 20985 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:16.881811 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-252bdc43-b698-4f86-bc31-d516322377fe tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:16.901318 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-252bdc43-b698-4f86-bc31-d516322377fe tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1317 microversion: 2.1 time: 0.289572 Feb 17 03:29:16.906381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 155/308] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:16 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:17.353776 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e4d14eab-901f-47da-996d-dd20d5268410 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:17.354534 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e4d14eab-901f-47da-996d-dd20d5268410 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:17.362969 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e4d14eab-901f-47da-996d-dd20d5268410 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:17.363474 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e4d14eab-901f-47da-996d-dd20d5268410 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:17.364299 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e4d14eab-901f-47da-996d-dd20d5268410 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:17.364787 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e4d14eab-901f-47da-996d-dd20d5268410 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:17.522380 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-80684813-383b-460e-8310-6829ff646e70 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:17.523452 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-80684813-383b-460e-8310-6829ff646e70 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:17.531717 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-80684813-383b-460e-8310-6829ff646e70 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:17.532226 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-80684813-383b-460e-8310-6829ff646e70 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:17.533087 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-80684813-383b-460e-8310-6829ff646e70 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:17.533626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-80684813-383b-460e-8310-6829ff646e70 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:17.576758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e4d14eab-901f-47da-996d-dd20d5268410 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:17.585662 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e4d14eab-901f-47da-996d-dd20d5268410 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.236820 Feb 17 03:29:17.586748 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 154/309] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:17 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:17.761788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3074aa4c-c774-459b-bc0d-35ed00b9e9da tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:17.762956 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3074aa4c-c774-459b-bc0d-35ed00b9e9da tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:17.770656 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3074aa4c-c774-459b-bc0d-35ed00b9e9da tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:17.771313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3074aa4c-c774-459b-bc0d-35ed00b9e9da tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:17.771992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3074aa4c-c774-459b-bc0d-35ed00b9e9da tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:17.772494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3074aa4c-c774-459b-bc0d-35ed00b9e9da tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:17.784117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-80684813-383b-460e-8310-6829ff646e70 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 20997 microversion: 2.1 time: 0.265619 Feb 17 03:29:17.785740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 156/310] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:17 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 20997 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:29:17.923469 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a864f0e2-ba8a-4d2a-bddc-128e8f50e270 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:17.924239 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a864f0e2-ba8a-4d2a-bddc-128e8f50e270 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:17.932772 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a864f0e2-ba8a-4d2a-bddc-128e8f50e270 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:17.933313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a864f0e2-ba8a-4d2a-bddc-128e8f50e270 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:17.934146 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a864f0e2-ba8a-4d2a-bddc-128e8f50e270 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:17.934675 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a864f0e2-ba8a-4d2a-bddc-128e8f50e270 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:17.948263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3074aa4c-c774-459b-bc0d-35ed00b9e9da tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 22813 microversion: 2.20 time: 0.190273 Feb 17 03:29:17.949066 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 155/311] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:17 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 22813 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:29:18.149692 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a864f0e2-ba8a-4d2a-bddc-128e8f50e270 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:18.158552 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a864f0e2-ba8a-4d2a-bddc-128e8f50e270 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1317 microversion: 2.1 time: 0.239517 Feb 17 03:29:18.159150 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 157/312] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:17 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:18.607250 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ec2a6ab4-c8e9-48b1-a324-18d94803bd8d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:18.608036 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ec2a6ab4-c8e9-48b1-a324-18d94803bd8d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:18.618712 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ec2a6ab4-c8e9-48b1-a324-18d94803bd8d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:18.618712 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ec2a6ab4-c8e9-48b1-a324-18d94803bd8d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:18.619148 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ec2a6ab4-c8e9-48b1-a324-18d94803bd8d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:18.619416 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ec2a6ab4-c8e9-48b1-a324-18d94803bd8d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:18.796836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-62782c3f-8127-47bb-b3b7-1fc555f59bc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:18.797926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-62782c3f-8127-47bb-b3b7-1fc555f59bc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:18.812181 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-62782c3f-8127-47bb-b3b7-1fc555f59bc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:18.812697 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-62782c3f-8127-47bb-b3b7-1fc555f59bc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:18.813652 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-62782c3f-8127-47bb-b3b7-1fc555f59bc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:18.814094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-62782c3f-8127-47bb-b3b7-1fc555f59bc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:18.907890 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ec2a6ab4-c8e9-48b1-a324-18d94803bd8d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:18.922005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ec2a6ab4-c8e9-48b1-a324-18d94803bd8d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1521 microversion: 2.1 time: 0.321646 Feb 17 03:29:18.924926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 156/313] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:18 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:18.968928 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b7482e00-bc58-4bbc-b7af-023c0b4c1fc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:18.970074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b7482e00-bc58-4bbc-b7af-023c0b4c1fc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:18.991821 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b7482e00-bc58-4bbc-b7af-023c0b4c1fc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:18.997456 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b7482e00-bc58-4bbc-b7af-023c0b4c1fc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:18.998590 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b7482e00-bc58-4bbc-b7af-023c0b4c1fc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:18.999303 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b7482e00-bc58-4bbc-b7af-023c0b4c1fc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:19.134499 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-62782c3f-8127-47bb-b3b7-1fc555f59bc2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 22715 microversion: 2.1 time: 0.341161 Feb 17 03:29:19.139768 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 158/314] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:18 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 22715 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:19.140450 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-b6a1facd-3f58-448d-aea9-708ee33dd375 req-cdd76376-74f5-40ab-9239-8cb3ed5eb08f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fbbd236-7b97-4182-8fe1-acbc901bf34e", "name": "network-vif-plugged", "status": "completed", "tag": "3f278c60-d4fc-48d2-a84d-a1bd008033aa"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:19.146609 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:29:19.146609 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:29:19.160094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-b6a1facd-3f58-448d-aea9-708ee33dd375 req-cdd76376-74f5-40ab-9239-8cb3ed5eb08f service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:19.160842 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-b6a1facd-3f58-448d-aea9-708ee33dd375 req-cdd76376-74f5-40ab-9239-8cb3ed5eb08f service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:19.192901 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-b6a1facd-3f58-448d-aea9-708ee33dd375 req-cdd76376-74f5-40ab-9239-8cb3ed5eb08f service nova] Creating event network-vif-plugged:3f278c60-d4fc-48d2-a84d-a1bd008033aa for instance 4fbbd236-7b97-4182-8fe1-acbc901bf34e on hv-cinder-75994 Feb 17 03:29:19.199305 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-b6a1facd-3f58-448d-aea9-708ee33dd375 req-cdd76376-74f5-40ab-9239-8cb3ed5eb08f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062455 Feb 17 03:29:19.200526 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 159/315] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:29:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:29:19.207659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ca859c8d-cbed-44f8-a68e-3f0a3c119e0e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:19.208765 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ca859c8d-cbed-44f8-a68e-3f0a3c119e0e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:19.218390 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca859c8d-cbed-44f8-a68e-3f0a3c119e0e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:19.218942 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca859c8d-cbed-44f8-a68e-3f0a3c119e0e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:19.219863 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca859c8d-cbed-44f8-a68e-3f0a3c119e0e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:19.220354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca859c8d-cbed-44f8-a68e-3f0a3c119e0e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:19.309078 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b7482e00-bc58-4bbc-b7af-023c0b4c1fc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 23790 microversion: 2.20 time: 0.350807 Feb 17 03:29:19.309971 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 157/316] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:18 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 23790 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:19.483950 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ca859c8d-cbed-44f8-a68e-3f0a3c119e0e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:19.495575 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ca859c8d-cbed-44f8-a68e-3f0a3c119e0e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1317 microversion: 2.1 time: 0.293615 Feb 17 03:29:19.496419 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 160/317] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:19 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:19.943741 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-45d12f83-1bde-49b9-bbb4-6a04855ca58c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:19.944768 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-45d12f83-1bde-49b9-bbb4-6a04855ca58c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:19.954186 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45d12f83-1bde-49b9-bbb4-6a04855ca58c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:19.954689 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45d12f83-1bde-49b9-bbb4-6a04855ca58c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:19.955530 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45d12f83-1bde-49b9-bbb4-6a04855ca58c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:19.956022 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45d12f83-1bde-49b9-bbb4-6a04855ca58c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:20.147902 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ef8b8b67-c2fd-4f33-bc34-0e7fb0c06bff tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:20.148956 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ef8b8b67-c2fd-4f33-bc34-0e7fb0c06bff tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:20.156885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef8b8b67-c2fd-4f33-bc34-0e7fb0c06bff tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:20.157429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef8b8b67-c2fd-4f33-bc34-0e7fb0c06bff tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:20.158280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef8b8b67-c2fd-4f33-bc34-0e7fb0c06bff tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:20.158778 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef8b8b67-c2fd-4f33-bc34-0e7fb0c06bff tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:20.178471 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-45d12f83-1bde-49b9-bbb4-6a04855ca58c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:20.188042 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-45d12f83-1bde-49b9-bbb4-6a04855ca58c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1501 microversion: 2.1 time: 0.248817 Feb 17 03:29:20.188628 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 158/318] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:19 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1501 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:20.204789 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e33feb8f-f5fa-4af6-9d3e-a7c66246f1fa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:20.205469 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e33feb8f-f5fa-4af6-9d3e-a7c66246f1fa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:20.212898 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e33feb8f-f5fa-4af6-9d3e-a7c66246f1fa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:20.213413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e33feb8f-f5fa-4af6-9d3e-a7c66246f1fa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:20.214431 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e33feb8f-f5fa-4af6-9d3e-a7c66246f1fa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:20.214920 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e33feb8f-f5fa-4af6-9d3e-a7c66246f1fa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:20.422422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e33feb8f-f5fa-4af6-9d3e-a7c66246f1fa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:20.431905 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e33feb8f-f5fa-4af6-9d3e-a7c66246f1fa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1514 microversion: 2.1 time: 0.230798 Feb 17 03:29:20.432490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 159/319] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:20 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1514 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:20.437202 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-206b5804-e59b-4b24-b5f2-3f0406efab70 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:20.438215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-206b5804-e59b-4b24-b5f2-3f0406efab70 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:20.445749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-206b5804-e59b-4b24-b5f2-3f0406efab70 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:20.446248 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-206b5804-e59b-4b24-b5f2-3f0406efab70 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:20.447065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-206b5804-e59b-4b24-b5f2-3f0406efab70 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:20.447553 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-206b5804-e59b-4b24-b5f2-3f0406efab70 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:26.552118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ef8b8b67-c2fd-4f33-bc34-0e7fb0c06bff tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 27751 microversion: 2.1 time: 6.407890 Feb 17 03:29:26.555663 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 161/320] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:20 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 27751 bytes in 6410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:29:26.558587 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3c7d2f0e-25eb-4556-b8b3-a6a56989e576 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:26.559350 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3c7d2f0e-25eb-4556-b8b3-a6a56989e576 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:26.567910 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3c7d2f0e-25eb-4556-b8b3-a6a56989e576 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:26.568417 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3c7d2f0e-25eb-4556-b8b3-a6a56989e576 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:26.569541 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3c7d2f0e-25eb-4556-b8b3-a6a56989e576 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:26.570034 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3c7d2f0e-25eb-4556-b8b3-a6a56989e576 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:26.782948 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3c7d2f0e-25eb-4556-b8b3-a6a56989e576 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:26.791703 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3c7d2f0e-25eb-4556-b8b3-a6a56989e576 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1317 microversion: 2.1 time: 0.237732 Feb 17 03:29:26.792290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 162/321] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:26 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:26.852947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-206b5804-e59b-4b24-b5f2-3f0406efab70 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 27785 microversion: 2.20 time: 6.419086 Feb 17 03:29:26.853991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 160/322] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:20 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 27785 bytes in 6421 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:27.508336 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-17ffe645-fc9a-4045-97c8-89fc78c8f12d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:27.509673 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-17ffe645-fc9a-4045-97c8-89fc78c8f12d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:27.528086 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-17ffe645-fc9a-4045-97c8-89fc78c8f12d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:27.528753 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-17ffe645-fc9a-4045-97c8-89fc78c8f12d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:27.529651 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-17ffe645-fc9a-4045-97c8-89fc78c8f12d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:27.530186 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-17ffe645-fc9a-4045-97c8-89fc78c8f12d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:27.564951 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-69b8e689-beb1-44aa-be78-a49e4e192da5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:27.566118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-69b8e689-beb1-44aa-be78-a49e4e192da5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:27.574991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-69b8e689-beb1-44aa-be78-a49e4e192da5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:27.575497 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-69b8e689-beb1-44aa-be78-a49e4e192da5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:27.576331 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-69b8e689-beb1-44aa-be78-a49e4e192da5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:27.576817 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-69b8e689-beb1-44aa-be78-a49e4e192da5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:27.597421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-17ffe645-fc9a-4045-97c8-89fc78c8f12d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lazy-loading 'flavor' on Instance uuid b4d58358-22a0-4562-9370-9574a29ec572 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:29:27.734221 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-69b8e689-beb1-44aa-be78-a49e4e192da5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 27751 microversion: 2.1 time: 0.173568 Feb 17 03:29:27.738984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 161/323] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:27 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 27751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:29:27.751589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-17ffe645-fc9a-4045-97c8-89fc78c8f12d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "POST /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572/action" status: 200 len: 32 microversion: 2.1 time: 0.247346 Feb 17 03:29:27.752396 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 163/324] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:27 2021] POST /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572/action => generated 32 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:29:27.777069 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f68c426a-a4df-4d07-be1b-27d89de2d733 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:27.778028 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f68c426a-a4df-4d07-be1b-27d89de2d733 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:27.787852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f68c426a-a4df-4d07-be1b-27d89de2d733 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:27.788578 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f68c426a-a4df-4d07-be1b-27d89de2d733 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:27.789481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f68c426a-a4df-4d07-be1b-27d89de2d733 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:27.790013 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f68c426a-a4df-4d07-be1b-27d89de2d733 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:27.810678 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-12d685be-61ae-4957-b30c-cb89c3a36429 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:27.811544 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-12d685be-61ae-4957-b30c-cb89c3a36429 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:27.819992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-12d685be-61ae-4957-b30c-cb89c3a36429 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:27.821221 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-12d685be-61ae-4957-b30c-cb89c3a36429 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:27.822142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-12d685be-61ae-4957-b30c-cb89c3a36429 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:27.822709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-12d685be-61ae-4957-b30c-cb89c3a36429 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:28.047226 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-12d685be-61ae-4957-b30c-cb89c3a36429 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:28.058037 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-12d685be-61ae-4957-b30c-cb89c3a36429 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1317 microversion: 2.1 time: 0.251924 Feb 17 03:29:28.058659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 164/325] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:27 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:28.063729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9424ee49-e913-483f-893e-35f64ac81fba tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:28.064756 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9424ee49-e913-483f-893e-35f64ac81fba tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:28.073517 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9424ee49-e913-483f-893e-35f64ac81fba tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:28.074027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9424ee49-e913-483f-893e-35f64ac81fba tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:28.074872 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9424ee49-e913-483f-893e-35f64ac81fba tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:28.075361 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9424ee49-e913-483f-893e-35f64ac81fba tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:28.203296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f68c426a-a4df-4d07-be1b-27d89de2d733 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:28.212248 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f68c426a-a4df-4d07-be1b-27d89de2d733 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.452941 Feb 17 03:29:28.212848 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 162/326] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:27 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:28.233563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9424ee49-e913-483f-893e-35f64ac81fba tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 27785 microversion: 2.20 time: 0.173450 Feb 17 03:29:28.235209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 165/327] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:28 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 27785 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:28.747735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-09b38e2a-991c-4749-8770-3119c9c514bc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:28.748791 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-09b38e2a-991c-4749-8770-3119c9c514bc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:28.756534 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09b38e2a-991c-4749-8770-3119c9c514bc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:28.757061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09b38e2a-991c-4749-8770-3119c9c514bc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:28.758030 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09b38e2a-991c-4749-8770-3119c9c514bc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:28.758430 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09b38e2a-991c-4749-8770-3119c9c514bc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:28.919101 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-09b38e2a-991c-4749-8770-3119c9c514bc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 27817 microversion: 2.1 time: 0.175170 Feb 17 03:29:28.920882 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 163/328] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:28 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 27817 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:29.077204 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-de2db0a0-02a1-482c-8dc6-294a55a5303d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:29.078026 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-de2db0a0-02a1-482c-8dc6-294a55a5303d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:29.087550 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-de2db0a0-02a1-482c-8dc6-294a55a5303d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:29.088068 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-de2db0a0-02a1-482c-8dc6-294a55a5303d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:29.088941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-de2db0a0-02a1-482c-8dc6-294a55a5303d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:29.089483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-de2db0a0-02a1-482c-8dc6-294a55a5303d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:29.233092 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8f90dcf2-0f7c-43aa-9789-1e14838ca5c7 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:29.234000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8f90dcf2-0f7c-43aa-9789-1e14838ca5c7 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:29.243935 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f90dcf2-0f7c-43aa-9789-1e14838ca5c7 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:29.244502 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f90dcf2-0f7c-43aa-9789-1e14838ca5c7 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:29.245465 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f90dcf2-0f7c-43aa-9789-1e14838ca5c7 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:29.246423 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f90dcf2-0f7c-43aa-9789-1e14838ca5c7 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:29.324220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-de2db0a0-02a1-482c-8dc6-294a55a5303d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:29.338010 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-de2db0a0-02a1-482c-8dc6-294a55a5303d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1506 microversion: 2.1 time: 0.265469 Feb 17 03:29:29.338828 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 166/329] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:29 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:29.348347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f66de9d5-de15-42b1-8dde-26cf83711608 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:29.349655 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f66de9d5-de15-42b1-8dde-26cf83711608 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:29.358248 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f66de9d5-de15-42b1-8dde-26cf83711608 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:29.358747 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f66de9d5-de15-42b1-8dde-26cf83711608 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:29.359582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f66de9d5-de15-42b1-8dde-26cf83711608 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:29.360070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f66de9d5-de15-42b1-8dde-26cf83711608 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:29.489974 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8f90dcf2-0f7c-43aa-9789-1e14838ca5c7 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:29.499361 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8f90dcf2-0f7c-43aa-9789-1e14838ca5c7 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.272560 Feb 17 03:29:29.499801 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 164/330] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:29 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:29.515436 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-08b35276-b2d5-46c9-b503-836ac0aecf05 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce762e97-cdd5-4b56-ac58-8cc4601a0c47"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:29.516622 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-08b35276-b2d5-46c9-b503-836ac0aecf05 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:29.524319 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-08b35276-b2d5-46c9-b503-836ac0aecf05 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:29.524979 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-08b35276-b2d5-46c9-b503-836ac0aecf05 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:29.525978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-08b35276-b2d5-46c9-b503-836ac0aecf05 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:29.526637 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-08b35276-b2d5-46c9-b503-836ac0aecf05 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:29.570167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f66de9d5-de15-42b1-8dde-26cf83711608 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 27912 microversion: 2.20 time: 0.228945 Feb 17 03:29:29.571692 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 167/331] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:29 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 27912 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:29.715335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-08b35276-b2d5-46c9-b503-836ac0aecf05 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] HTTP exception thrown: Invalid volume: volume ce762e97-cdd5-4b56-ac58-8cc4601a0c47 is already attached to instances: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 Feb 17 03:29:29.716002 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-08b35276-b2d5-46c9-b503-836ac0aecf05 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Returning 400 to user: Invalid volume: volume ce762e97-cdd5-4b56-ac58-8cc4601a0c47 is already attached to instances: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:29:29.716892 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-08b35276-b2d5-46c9-b503-836ac0aecf05 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "POST /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.205554 Feb 17 03:29:29.717532 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 165/332] 10.222.0.57 () {60 vars in 1313 bytes} [Wed Feb 17 03:29:29 2021] POST /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e/os-volume_attachments => generated 174 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 03:29:29.833628 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-115d4f38-2d66-4ffa-a58a-80368cecd079 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:29.837073 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-115d4f38-2d66-4ffa-a58a-80368cecd079 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:29.843014 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-115d4f38-2d66-4ffa-a58a-80368cecd079 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:29.843525 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-115d4f38-2d66-4ffa-a58a-80368cecd079 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:29.844378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-115d4f38-2d66-4ffa-a58a-80368cecd079 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:29.844865 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-115d4f38-2d66-4ffa-a58a-80368cecd079 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:29.932538 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c098098d-c0a9-4a17-ab0d-6ecc5400e708 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:29.933635 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c098098d-c0a9-4a17-ab0d-6ecc5400e708 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:29.942738 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c098098d-c0a9-4a17-ab0d-6ecc5400e708 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:29.943243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c098098d-c0a9-4a17-ab0d-6ecc5400e708 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:29.944335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c098098d-c0a9-4a17-ab0d-6ecc5400e708 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:29.944836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c098098d-c0a9-4a17-ab0d-6ecc5400e708 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:30.051645 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-115d4f38-2d66-4ffa-a58a-80368cecd079 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lazy-loading 'services' on Instance uuid 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:29:30.119275 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c098098d-c0a9-4a17-ab0d-6ecc5400e708 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 27996 microversion: 2.1 time: 0.191103 Feb 17 03:29:30.120297 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 166/333] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:29 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 27996 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:30.215654 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-115d4f38-2d66-4ffa-a58a-80368cecd079 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "DELETE /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96/os-volume_attachments/ce762e97-cdd5-4b56-ac58-8cc4601a0c47" status: 202 len: 0 microversion: 2.1 time: 0.386379 Feb 17 03:29:30.216410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 168/334] 10.222.0.57 () {58 vars in 1406 bytes} [Wed Feb 17 03:29:29 2021] DELETE /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96/os-volume_attachments/ce762e97-cdd5-4b56-ac58-8cc4601a0c47 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:30.518687 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6ec54147-8d21-4538-afc1-88fc19ef2b40 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:30.519591 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6ec54147-8d21-4538-afc1-88fc19ef2b40 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:30.529059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6ec54147-8d21-4538-afc1-88fc19ef2b40 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:30.529593 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6ec54147-8d21-4538-afc1-88fc19ef2b40 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:30.530484 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6ec54147-8d21-4538-afc1-88fc19ef2b40 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:30.530929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6ec54147-8d21-4538-afc1-88fc19ef2b40 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:30.586913 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-744cf15a-6062-4bda-bce6-f097672073ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:30.588383 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-744cf15a-6062-4bda-bce6-f097672073ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:30.597277 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-744cf15a-6062-4bda-bce6-f097672073ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:30.598076 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-744cf15a-6062-4bda-bce6-f097672073ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:30.599110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-744cf15a-6062-4bda-bce6-f097672073ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:30.599796 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-744cf15a-6062-4bda-bce6-f097672073ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:30.766603 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6ec54147-8d21-4538-afc1-88fc19ef2b40 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:30.776105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6ec54147-8d21-4538-afc1-88fc19ef2b40 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.261973 Feb 17 03:29:30.776693 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 167/335] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:30 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:30.865351 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-744cf15a-6062-4bda-bce6-f097672073ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28048 microversion: 2.20 time: 0.284633 Feb 17 03:29:30.866723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 169/336] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:30 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28048 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:31.132176 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-57ab8f01-4116-42e3-80c5-5b2653a85c67 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:31.133925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-57ab8f01-4116-42e3-80c5-5b2653a85c67 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:31.142225 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-57ab8f01-4116-42e3-80c5-5b2653a85c67 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:31.142734 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-57ab8f01-4116-42e3-80c5-5b2653a85c67 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:31.143589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-57ab8f01-4116-42e3-80c5-5b2653a85c67 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:31.144087 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-57ab8f01-4116-42e3-80c5-5b2653a85c67 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:31.306353 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-57ab8f01-4116-42e3-80c5-5b2653a85c67 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.178157 Feb 17 03:29:31.307115 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 168/337] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:31 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:31.796499 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-92018167-b8ae-4ee7-a41d-83fd27b41ed5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:31.797306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-92018167-b8ae-4ee7-a41d-83fd27b41ed5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:31.813713 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-92018167-b8ae-4ee7-a41d-83fd27b41ed5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:31.814459 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-92018167-b8ae-4ee7-a41d-83fd27b41ed5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:31.815517 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-92018167-b8ae-4ee7-a41d-83fd27b41ed5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:31.816505 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-92018167-b8ae-4ee7-a41d-83fd27b41ed5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:31.879088 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-20535663-ffeb-4852-9acd-205a574e3d0b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:31.881257 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-20535663-ffeb-4852-9acd-205a574e3d0b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:31.902817 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-20535663-ffeb-4852-9acd-205a574e3d0b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:31.903555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-20535663-ffeb-4852-9acd-205a574e3d0b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:31.904501 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-20535663-ffeb-4852-9acd-205a574e3d0b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:31.905000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-20535663-ffeb-4852-9acd-205a574e3d0b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:32.103800 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-92018167-b8ae-4ee7-a41d-83fd27b41ed5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:32.105150 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-20535663-ffeb-4852-9acd-205a574e3d0b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.230645 Feb 17 03:29:32.106180 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 169/338] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:31 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:32.117284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-92018167-b8ae-4ee7-a41d-83fd27b41ed5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.325077 Feb 17 03:29:32.117913 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 170/339] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:31 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:32.319036 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ed2f7e84-56c5-467d-9eb6-ee5a7f2bb1cf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:32.320957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ed2f7e84-56c5-467d-9eb6-ee5a7f2bb1cf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:32.329402 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ed2f7e84-56c5-467d-9eb6-ee5a7f2bb1cf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:32.329914 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ed2f7e84-56c5-467d-9eb6-ee5a7f2bb1cf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:32.330757 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ed2f7e84-56c5-467d-9eb6-ee5a7f2bb1cf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:32.331234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ed2f7e84-56c5-467d-9eb6-ee5a7f2bb1cf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:32.499704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ed2f7e84-56c5-467d-9eb6-ee5a7f2bb1cf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.185078 Feb 17 03:29:32.500658 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 170/340] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:32 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:32.693873 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f29582d8-8872-477c-b454-fde11b25a2e9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1569108699", "imageRef": "27891a64-31b3-4754-87b4-bf609a12c59a", "flavorRef": "452", "networks": [{"uuid": "90e5bf38-a0dc-48bd-9401-739bcf8a5d8a"}]}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:33.119368 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-30b2cff7-6e93-46d1-9993-e871ebabbad7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:33.120487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-30b2cff7-6e93-46d1-9993-e871ebabbad7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:33.129510 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30b2cff7-6e93-46d1-9993-e871ebabbad7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:33.130139 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30b2cff7-6e93-46d1-9993-e871ebabbad7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:33.131286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30b2cff7-6e93-46d1-9993-e871ebabbad7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:33.131854 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30b2cff7-6e93-46d1-9993-e871ebabbad7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:33.299370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-30b2cff7-6e93-46d1-9993-e871ebabbad7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.185149 Feb 17 03:29:33.301244 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 171/341] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:33 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:33.308719 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-491f2fe9-11bc-478b-acc3-1f3dd48475d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:33.309880 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-491f2fe9-11bc-478b-acc3-1f3dd48475d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:33.319597 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-491f2fe9-11bc-478b-acc3-1f3dd48475d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:33.320319 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-491f2fe9-11bc-478b-acc3-1f3dd48475d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:33.321430 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-491f2fe9-11bc-478b-acc3-1f3dd48475d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:33.321929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-491f2fe9-11bc-478b-acc3-1f3dd48475d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:33.568246 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-491f2fe9-11bc-478b-acc3-1f3dd48475d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:33.580184 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-491f2fe9-11bc-478b-acc3-1f3dd48475d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.277282 Feb 17 03:29:33.580796 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 172/342] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:33 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:33.586443 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a9a725ad-4a3e-47c2-bbb8-d7121f522345 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:33.587447 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a9a725ad-4a3e-47c2-bbb8-d7121f522345 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:33.595220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a9a725ad-4a3e-47c2-bbb8-d7121f522345 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:33.595966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a9a725ad-4a3e-47c2-bbb8-d7121f522345 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:33.596785 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a9a725ad-4a3e-47c2-bbb8-d7121f522345 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:33.597510 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a9a725ad-4a3e-47c2-bbb8-d7121f522345 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:33.749691 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a9a725ad-4a3e-47c2-bbb8-d7121f522345 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.167284 Feb 17 03:29:33.754041 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 173/343] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:33 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:34.312851 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5af8bb6f-ce6c-48ed-b601-391a4aa7d152 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:34.314058 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5af8bb6f-ce6c-48ed-b601-391a4aa7d152 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:34.323680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5af8bb6f-ce6c-48ed-b601-391a4aa7d152 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:34.324191 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5af8bb6f-ce6c-48ed-b601-391a4aa7d152 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:34.325062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5af8bb6f-ce6c-48ed-b601-391a4aa7d152 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:34.327369 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5af8bb6f-ce6c-48ed-b601-391a4aa7d152 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:34.466787 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5af8bb6f-ce6c-48ed-b601-391a4aa7d152 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.155893 Feb 17 03:29:34.466787 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 174/344] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:34 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:29:34.600018 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8e8d5a8e-f71a-4d8a-bcf0-cb8774ee292d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:34.600792 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8e8d5a8e-f71a-4d8a-bcf0-cb8774ee292d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:34.615119 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8e8d5a8e-f71a-4d8a-bcf0-cb8774ee292d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:34.615634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8e8d5a8e-f71a-4d8a-bcf0-cb8774ee292d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:34.616509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8e8d5a8e-f71a-4d8a-bcf0-cb8774ee292d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:34.617714 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8e8d5a8e-f71a-4d8a-bcf0-cb8774ee292d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:34.851020 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8e8d5a8e-f71a-4d8a-bcf0-cb8774ee292d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:34.860923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8e8d5a8e-f71a-4d8a-bcf0-cb8774ee292d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.265490 Feb 17 03:29:34.866983 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 175/345] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:34 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:34.866983 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8b8fe800-3498-4afc-b1dc-a6d2e0b4da0f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:34.867262 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8b8fe800-3498-4afc-b1dc-a6d2e0b4da0f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:34.876516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8b8fe800-3498-4afc-b1dc-a6d2e0b4da0f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:34.877235 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8b8fe800-3498-4afc-b1dc-a6d2e0b4da0f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:34.878237 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8b8fe800-3498-4afc-b1dc-a6d2e0b4da0f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:34.878879 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8b8fe800-3498-4afc-b1dc-a6d2e0b4da0f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:35.038552 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8b8fe800-3498-4afc-b1dc-a6d2e0b4da0f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.174801 Feb 17 03:29:35.040422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 176/346] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:34 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:35.478435 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9b8421ee-0efd-42e9-8631-ab2d4887d811 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:35.479611 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9b8421ee-0efd-42e9-8631-ab2d4887d811 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:35.488120 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9b8421ee-0efd-42e9-8631-ab2d4887d811 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:35.488624 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9b8421ee-0efd-42e9-8631-ab2d4887d811 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:35.489556 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9b8421ee-0efd-42e9-8631-ab2d4887d811 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:35.490010 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9b8421ee-0efd-42e9-8631-ab2d4887d811 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:35.639341 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9b8421ee-0efd-42e9-8631-ab2d4887d811 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.165166 Feb 17 03:29:35.643545 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 177/347] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:35 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:29:35.880275 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9bcdbe77-35f2-45cc-a860-94e57904fddf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:35.881068 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9bcdbe77-35f2-45cc-a860-94e57904fddf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:35.890607 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9bcdbe77-35f2-45cc-a860-94e57904fddf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:35.891414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9bcdbe77-35f2-45cc-a860-94e57904fddf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:35.892599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9bcdbe77-35f2-45cc-a860-94e57904fddf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:35.893405 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9bcdbe77-35f2-45cc-a860-94e57904fddf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:36.217369 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9bcdbe77-35f2-45cc-a860-94e57904fddf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:36.226824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9bcdbe77-35f2-45cc-a860-94e57904fddf tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.350744 Feb 17 03:29:36.227424 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 178/348] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:35 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:36.232793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b08427c3-ae9c-4071-af57-b2780cde420e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:36.234222 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b08427c3-ae9c-4071-af57-b2780cde420e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:36.242984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b08427c3-ae9c-4071-af57-b2780cde420e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:36.243498 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b08427c3-ae9c-4071-af57-b2780cde420e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:36.244382 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b08427c3-ae9c-4071-af57-b2780cde420e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:36.244791 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b08427c3-ae9c-4071-af57-b2780cde420e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:36.402373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b08427c3-ae9c-4071-af57-b2780cde420e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.173570 Feb 17 03:29:36.403512 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 179/349] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:36 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:36.604324 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-f29582d8-8872-477c-b454-fde11b25a2e9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] validate_networks() for [('90e5bf38-a0dc-48bd-9401-739bcf8a5d8a', None, None, None)] {{(pid=98103) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:29:36.653466 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2031209a-85be-4c43-90c9-60cc2a88c690 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:36.654852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2031209a-85be-4c43-90c9-60cc2a88c690 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:36.664380 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2031209a-85be-4c43-90c9-60cc2a88c690 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:36.665096 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2031209a-85be-4c43-90c9-60cc2a88c690 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:36.666235 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2031209a-85be-4c43-90c9-60cc2a88c690 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:36.666878 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2031209a-85be-4c43-90c9-60cc2a88c690 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:36.822522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2031209a-85be-4c43-90c9-60cc2a88c690 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.174322 Feb 17 03:29:36.823439 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 180/350] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:36 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:29:37.230907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-f29582d8-8872-477c-b454-fde11b25a2e9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:29:37.231389 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-f29582d8-8872-477c-b454-fde11b25a2e9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:29:37.232265 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-f29582d8-8872-477c-b454-fde11b25a2e9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:29:37.232731 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-f29582d8-8872-477c-b454-fde11b25a2e9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:29:37.233411 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-f29582d8-8872-477c-b454-fde11b25a2e9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:29:37.246855 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-deb70a70-25d4-46dd-9c89-09652ab4029e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:37.247649 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-deb70a70-25d4-46dd-9c89-09652ab4029e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:37.257764 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f29582d8-8872-477c-b454-fde11b25a2e9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:37.258267 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f29582d8-8872-477c-b454-fde11b25a2e9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:37.259137 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f29582d8-8872-477c-b454-fde11b25a2e9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:37.259628 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f29582d8-8872-477c-b454-fde11b25a2e9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:37.268984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-deb70a70-25d4-46dd-9c89-09652ab4029e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:37.269550 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-deb70a70-25d4-46dd-9c89-09652ab4029e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:37.270389 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-deb70a70-25d4-46dd-9c89-09652ab4029e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:37.270861 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-deb70a70-25d4-46dd-9c89-09652ab4029e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:37.442513 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-f29582d8-8872-477c-b454-fde11b25a2e9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Getting quotas for project 41ae341c7001465897265b1c5eda9767. Resources: {'ram', 'cores', 'instances'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:29:37.447516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-f29582d8-8872-477c-b454-fde11b25a2e9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Getting quotas for user 4d9f8d95ac0a4a4bb6aad0bbc963d08d and project 41ae341c7001465897265b1c5eda9767. Resources: {'ram', 'cores', 'instances'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:29:37.459480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f29582d8-8872-477c-b454-fde11b25a2e9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Going to run 1 instances... {{(pid=98103) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:29:37.462762 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f29582d8-8872-477c-b454-fde11b25a2e9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27891a64-31b3-4754-87b4-bf609a12c59a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:29:37.514722 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f29582d8-8872-477c-b454-fde11b25a2e9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.825443 Feb 17 03:29:37.515919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 171/351] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:29:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 4827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:29:37.526685 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-20f52ac1-c205-4b1e-a0f5-88a6c52112e1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:37.528227 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-20f52ac1-c205-4b1e-a0f5-88a6c52112e1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:37.537895 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-deb70a70-25d4-46dd-9c89-09652ab4029e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:37.538403 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-20f52ac1-c205-4b1e-a0f5-88a6c52112e1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:37.539182 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-20f52ac1-c205-4b1e-a0f5-88a6c52112e1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:37.540025 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-20f52ac1-c205-4b1e-a0f5-88a6c52112e1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:37.540504 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-20f52ac1-c205-4b1e-a0f5-88a6c52112e1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:37.547292 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-deb70a70-25d4-46dd-9c89-09652ab4029e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.305108 Feb 17 03:29:37.547883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 181/352] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:37 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:37.552481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-78e50baa-da7b-4fc8-9467-853d6810f4a9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:37.553212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-78e50baa-da7b-4fc8-9467-853d6810f4a9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:37.637611 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-78e50baa-da7b-4fc8-9467-853d6810f4a9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:37.646901 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-78e50baa-da7b-4fc8-9467-853d6810f4a9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1218 microversion: 2.1 time: 0.097947 Feb 17 03:29:37.647818 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 182/353] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:37 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:37.698218 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-20f52ac1-c205-4b1e-a0f5-88a6c52112e1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.180718 Feb 17 03:29:37.698999 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 172/354] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:37 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:37.835022 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1e4fa9ff-bbf9-4820-b703-410e033eb470 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:37.836429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1e4fa9ff-bbf9-4820-b703-410e033eb470 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:37.845348 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e4fa9ff-bbf9-4820-b703-410e033eb470 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:37.846021 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e4fa9ff-bbf9-4820-b703-410e033eb470 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:37.846875 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e4fa9ff-bbf9-4820-b703-410e033eb470 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:37.847347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e4fa9ff-bbf9-4820-b703-410e033eb470 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:38.016586 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1e4fa9ff-bbf9-4820-b703-410e033eb470 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.185168 Feb 17 03:29:38.018215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 183/355] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:37 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:38.570944 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f7441b3c-6d01-4601-8579-cfaefdd3ff87 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:38.572243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f7441b3c-6d01-4601-8579-cfaefdd3ff87 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:38.580885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7441b3c-6d01-4601-8579-cfaefdd3ff87 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:38.581467 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7441b3c-6d01-4601-8579-cfaefdd3ff87 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:38.582314 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7441b3c-6d01-4601-8579-cfaefdd3ff87 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:38.582803 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7441b3c-6d01-4601-8579-cfaefdd3ff87 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:38.669271 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3af18b61-454b-4c87-b9d6-bbac068e51f1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:38.670757 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3af18b61-454b-4c87-b9d6-bbac068e51f1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:38.682346 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3af18b61-454b-4c87-b9d6-bbac068e51f1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:38.683586 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3af18b61-454b-4c87-b9d6-bbac068e51f1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:38.684629 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3af18b61-454b-4c87-b9d6-bbac068e51f1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:38.685747 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3af18b61-454b-4c87-b9d6-bbac068e51f1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:38.860008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f7441b3c-6d01-4601-8579-cfaefdd3ff87 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:38.880228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f7441b3c-6d01-4601-8579-cfaefdd3ff87 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.318230 Feb 17 03:29:38.881252 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 173/356] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:38 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:38.905646 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-27c9421b-9cda-438b-afbe-d193978d0217 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:38.907380 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-27c9421b-9cda-438b-afbe-d193978d0217 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:38.921377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-27c9421b-9cda-438b-afbe-d193978d0217 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:38.922051 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-27c9421b-9cda-438b-afbe-d193978d0217 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:38.923000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-27c9421b-9cda-438b-afbe-d193978d0217 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:38.924066 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-27c9421b-9cda-438b-afbe-d193978d0217 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:39.076957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-27c9421b-9cda-438b-afbe-d193978d0217 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.181826 Feb 17 03:29:39.078212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 174/357] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:38 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:39.084961 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9a55d227-7d42-4cb1-948b-9da75ee7aeb5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:39.086142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9a55d227-7d42-4cb1-948b-9da75ee7aeb5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:39.095156 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a55d227-7d42-4cb1-948b-9da75ee7aeb5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:39.095952 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a55d227-7d42-4cb1-948b-9da75ee7aeb5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:39.096993 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a55d227-7d42-4cb1-948b-9da75ee7aeb5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:39.097736 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a55d227-7d42-4cb1-948b-9da75ee7aeb5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:39.148925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3af18b61-454b-4c87-b9d6-bbac068e51f1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:39.167727 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3af18b61-454b-4c87-b9d6-bbac068e51f1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1270 microversion: 2.1 time: 0.504877 Feb 17 03:29:39.168886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 184/358] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:38 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1270 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:29:39.276335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9a55d227-7d42-4cb1-948b-9da75ee7aeb5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.196195 Feb 17 03:29:39.277932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 175/359] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:39 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:39.901511 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-387b15fc-6f7e-4135-aeba-90f0c02ba654 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:39.902159 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-387b15fc-6f7e-4135-aeba-90f0c02ba654 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:39.912415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-387b15fc-6f7e-4135-aeba-90f0c02ba654 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:39.914158 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-387b15fc-6f7e-4135-aeba-90f0c02ba654 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:39.915514 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-387b15fc-6f7e-4135-aeba-90f0c02ba654 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:39.916162 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-387b15fc-6f7e-4135-aeba-90f0c02ba654 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:40.091254 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b141ab1a-22de-4102-a63b-7c698a73c65f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:40.092660 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b141ab1a-22de-4102-a63b-7c698a73c65f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:40.101930 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b141ab1a-22de-4102-a63b-7c698a73c65f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:40.102723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b141ab1a-22de-4102-a63b-7c698a73c65f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:40.103560 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b141ab1a-22de-4102-a63b-7c698a73c65f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:40.104283 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b141ab1a-22de-4102-a63b-7c698a73c65f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:40.296501 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b141ab1a-22de-4102-a63b-7c698a73c65f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.209251 Feb 17 03:29:40.302417 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 176/360] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:40 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:40.309907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-45d0f9c1-b024-4cdd-9a25-5bb5630e05bd tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:40.311073 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-45d0f9c1-b024-4cdd-9a25-5bb5630e05bd tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:40.327636 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45d0f9c1-b024-4cdd-9a25-5bb5630e05bd tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:40.328557 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45d0f9c1-b024-4cdd-9a25-5bb5630e05bd tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:40.330119 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45d0f9c1-b024-4cdd-9a25-5bb5630e05bd tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:40.330699 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45d0f9c1-b024-4cdd-9a25-5bb5630e05bd tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:40.365509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-387b15fc-6f7e-4135-aeba-90f0c02ba654 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:40.378633 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-387b15fc-6f7e-4135-aeba-90f0c02ba654 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.482413 Feb 17 03:29:40.380157 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 185/361] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:39 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:40.386046 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-25859779-4275-469d-9e95-33209ccde212 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:40.387525 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-25859779-4275-469d-9e95-33209ccde212 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:40.395863 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-25859779-4275-469d-9e95-33209ccde212 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:40.397479 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-25859779-4275-469d-9e95-33209ccde212 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:40.399137 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-25859779-4275-469d-9e95-33209ccde212 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:40.399953 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-25859779-4275-469d-9e95-33209ccde212 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:40.509090 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-45d0f9c1-b024-4cdd-9a25-5bb5630e05bd tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:40.522629 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-45d0f9c1-b024-4cdd-9a25-5bb5630e05bd tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1276 microversion: 2.1 time: 0.214067 Feb 17 03:29:40.529610 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 177/362] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:40 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1276 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:40.808516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-25859779-4275-469d-9e95-33209ccde212 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.426696 Feb 17 03:29:40.809211 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 186/363] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:40 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:41.310434 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-76c72311-562b-4482-a34e-793cef77a29e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:41.311484 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-76c72311-562b-4482-a34e-793cef77a29e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:41.320386 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-76c72311-562b-4482-a34e-793cef77a29e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:41.321085 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-76c72311-562b-4482-a34e-793cef77a29e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:41.322149 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-76c72311-562b-4482-a34e-793cef77a29e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:41.322833 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-76c72311-562b-4482-a34e-793cef77a29e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:41.399609 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e11667d9-e34d-4c01-a9eb-24192d47a38f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:41.400984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e11667d9-e34d-4c01-a9eb-24192d47a38f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:41.419336 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e11667d9-e34d-4c01-a9eb-24192d47a38f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:41.421440 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e11667d9-e34d-4c01-a9eb-24192d47a38f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:41.423052 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e11667d9-e34d-4c01-a9eb-24192d47a38f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:41.423767 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e11667d9-e34d-4c01-a9eb-24192d47a38f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:41.519809 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-76c72311-562b-4482-a34e-793cef77a29e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.212814 Feb 17 03:29:41.520681 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 178/364] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:41 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:41.548596 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7115eba3-d0a3-4c8c-b69c-be7f10fad52c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:41.549389 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7115eba3-d0a3-4c8c-b69c-be7f10fad52c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:41.558806 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7115eba3-d0a3-4c8c-b69c-be7f10fad52c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:41.559134 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7115eba3-d0a3-4c8c-b69c-be7f10fad52c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:41.560248 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7115eba3-d0a3-4c8c-b69c-be7f10fad52c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:41.561113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7115eba3-d0a3-4c8c-b69c-be7f10fad52c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:41.839389 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7115eba3-d0a3-4c8c-b69c-be7f10fad52c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:41.865094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7115eba3-d0a3-4c8c-b69c-be7f10fad52c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.320935 Feb 17 03:29:41.869851 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 179/365] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:41 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:41.900272 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bfb4223f-ced6-42f0-93dd-b40045ccb797 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:41.901460 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bfb4223f-ced6-42f0-93dd-b40045ccb797 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:41.910221 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bfb4223f-ced6-42f0-93dd-b40045ccb797 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:41.911235 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bfb4223f-ced6-42f0-93dd-b40045ccb797 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:41.917966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bfb4223f-ced6-42f0-93dd-b40045ccb797 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:41.918676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bfb4223f-ced6-42f0-93dd-b40045ccb797 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:42.037834 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e11667d9-e34d-4c01-a9eb-24192d47a38f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:42.058307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e11667d9-e34d-4c01-a9eb-24192d47a38f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.664114 Feb 17 03:29:42.069519 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 187/366] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:41 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:42.131593 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bfb4223f-ced6-42f0-93dd-b40045ccb797 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.256358 Feb 17 03:29:42.132648 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 180/367] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:41 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:42.532535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f4ea523a-eb12-4597-9670-06398ba2afc3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:42.533776 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f4ea523a-eb12-4597-9670-06398ba2afc3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:42.543568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4ea523a-eb12-4597-9670-06398ba2afc3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:42.544272 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4ea523a-eb12-4597-9670-06398ba2afc3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:42.545296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4ea523a-eb12-4597-9670-06398ba2afc3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:42.545932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4ea523a-eb12-4597-9670-06398ba2afc3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:42.573854 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-26833b65-5d00-4d62-9012-5e5bb1900627 req-9774c79f-5d60-48c3-b5f3-9604443c7590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c691a18-0bdc-4921-9246-3de1981b4c2b", "tag": "a0f6513d-f485-4f7e-a35c-1db2dcf6b082"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:42.575473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:29:42.575473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:29:42.615087 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-26833b65-5d00-4d62-9012-5e5bb1900627 req-9774c79f-5d60-48c3-b5f3-9604443c7590 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:42.615589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-26833b65-5d00-4d62-9012-5e5bb1900627 req-9774c79f-5d60-48c3-b5f3-9604443c7590 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:42.643507 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-26833b65-5d00-4d62-9012-5e5bb1900627 req-9774c79f-5d60-48c3-b5f3-9604443c7590 service nova] Creating event network-changed:a0f6513d-f485-4f7e-a35c-1db2dcf6b082 for instance 9c691a18-0bdc-4921-9246-3de1981b4c2b on hv-cinder-75994 Feb 17 03:29:42.649680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-26833b65-5d00-4d62-9012-5e5bb1900627 req-9774c79f-5d60-48c3-b5f3-9604443c7590 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080554 Feb 17 03:29:42.650571 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 181/368] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:29:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:29:42.797548 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f4ea523a-eb12-4597-9670-06398ba2afc3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.268922 Feb 17 03:29:42.799135 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 188/369] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:42 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:42.889003 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b603d3d1-737a-46e0-8bf3-91a6226d0ea7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:42.889651 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b603d3d1-737a-46e0-8bf3-91a6226d0ea7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:42.906168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b603d3d1-737a-46e0-8bf3-91a6226d0ea7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:42.906697 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b603d3d1-737a-46e0-8bf3-91a6226d0ea7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:42.907560 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b603d3d1-737a-46e0-8bf3-91a6226d0ea7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:42.908054 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b603d3d1-737a-46e0-8bf3-91a6226d0ea7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:43.078471 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3f550a9a-c3c7-4dbd-92f3-0782df90b0fe tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:43.079253 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3f550a9a-c3c7-4dbd-92f3-0782df90b0fe tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:43.098879 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3f550a9a-c3c7-4dbd-92f3-0782df90b0fe tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:43.099387 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3f550a9a-c3c7-4dbd-92f3-0782df90b0fe tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:43.100448 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3f550a9a-c3c7-4dbd-92f3-0782df90b0fe tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:43.100950 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3f550a9a-c3c7-4dbd-92f3-0782df90b0fe tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:43.277912 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b603d3d1-737a-46e0-8bf3-91a6226d0ea7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:43.287512 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b603d3d1-737a-46e0-8bf3-91a6226d0ea7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.403276 Feb 17 03:29:43.288584 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 182/370] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:42 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:43.293637 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1b6ba4af-6661-40fb-970b-eebdecbf35d6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:43.294853 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1b6ba4af-6661-40fb-970b-eebdecbf35d6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:43.302984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1b6ba4af-6661-40fb-970b-eebdecbf35d6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:43.303694 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1b6ba4af-6661-40fb-970b-eebdecbf35d6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:43.305286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1b6ba4af-6661-40fb-970b-eebdecbf35d6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:43.305918 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1b6ba4af-6661-40fb-970b-eebdecbf35d6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:43.453093 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1b6ba4af-6661-40fb-970b-eebdecbf35d6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.162506 Feb 17 03:29:43.454182 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 183/371] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:43 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:43.774803 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3f550a9a-c3c7-4dbd-92f3-0782df90b0fe tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:43.784477 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3f550a9a-c3c7-4dbd-92f3-0782df90b0fe tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.711325 Feb 17 03:29:43.785086 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 189/372] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:43 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:43.811848 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b3627a8e-87e4-48ee-8734-105e7336fb97 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:43.813133 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b3627a8e-87e4-48ee-8734-105e7336fb97 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:43.822508 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b3627a8e-87e4-48ee-8734-105e7336fb97 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:43.823288 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b3627a8e-87e4-48ee-8734-105e7336fb97 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:43.824326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b3627a8e-87e4-48ee-8734-105e7336fb97 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:43.825005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b3627a8e-87e4-48ee-8734-105e7336fb97 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:44.306150 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d51e0939-d055-479e-91f7-994d40757af3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:44.306979 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d51e0939-d055-479e-91f7-994d40757af3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:44.315291 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d51e0939-d055-479e-91f7-994d40757af3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:44.315899 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d51e0939-d055-479e-91f7-994d40757af3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:44.316931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d51e0939-d055-479e-91f7-994d40757af3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:44.317451 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d51e0939-d055-479e-91f7-994d40757af3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:44.753535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d51e0939-d055-479e-91f7-994d40757af3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:44.762711 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d51e0939-d055-479e-91f7-994d40757af3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.460540 Feb 17 03:29:44.763298 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 190/373] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:44 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:44.770464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-641bee25-de1b-4379-930b-dec78fbbdae6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:44.771509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-641bee25-de1b-4379-930b-dec78fbbdae6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:44.780013 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-641bee25-de1b-4379-930b-dec78fbbdae6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:44.780515 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-641bee25-de1b-4379-930b-dec78fbbdae6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:44.781267 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-641bee25-de1b-4379-930b-dec78fbbdae6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:44.781955 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-641bee25-de1b-4379-930b-dec78fbbdae6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:44.812288 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b3627a8e-87e4-48ee-8734-105e7336fb97 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 1.005401 Feb 17 03:29:44.812977 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 184/374] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:43 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:29:44.818890 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e8ace071-f585-4e68-bd14-ea2714762591 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:44.820156 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e8ace071-f585-4e68-bd14-ea2714762591 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:44.828920 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e8ace071-f585-4e68-bd14-ea2714762591 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:44.829428 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e8ace071-f585-4e68-bd14-ea2714762591 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:44.830285 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e8ace071-f585-4e68-bd14-ea2714762591 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:44.830760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e8ace071-f585-4e68-bd14-ea2714762591 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:44.916464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-641bee25-de1b-4379-930b-dec78fbbdae6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.151423 Feb 17 03:29:44.917555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 191/375] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:44 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:45.050449 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e8ace071-f585-4e68-bd14-ea2714762591 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:45.060079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e8ace071-f585-4e68-bd14-ea2714762591 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.245595 Feb 17 03:29:45.060780 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 185/376] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:44 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:45.782312 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4ab105ae-4741-41a6-9303-bfafc5163858 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:45.783073 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4ab105ae-4741-41a6-9303-bfafc5163858 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:45.791540 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ab105ae-4741-41a6-9303-bfafc5163858 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:45.792018 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ab105ae-4741-41a6-9303-bfafc5163858 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:45.792846 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ab105ae-4741-41a6-9303-bfafc5163858 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:45.793369 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ab105ae-4741-41a6-9303-bfafc5163858 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:45.824855 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e6ffcfd2-bbf1-4609-a9d2-8de49b874b55 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:45.825930 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e6ffcfd2-bbf1-4609-a9d2-8de49b874b55 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:45.834629 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e6ffcfd2-bbf1-4609-a9d2-8de49b874b55 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:45.835123 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e6ffcfd2-bbf1-4609-a9d2-8de49b874b55 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:45.836719 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e6ffcfd2-bbf1-4609-a9d2-8de49b874b55 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:45.837245 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e6ffcfd2-bbf1-4609-a9d2-8de49b874b55 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:46.058232 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4ab105ae-4741-41a6-9303-bfafc5163858 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:46.067449 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4ab105ae-4741-41a6-9303-bfafc5163858 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.289607 Feb 17 03:29:46.067991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 192/377] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:45 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:46.073970 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ac453ce0-1845-4d97-a1a5-344e59aa2db4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:46.075004 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ac453ce0-1845-4d97-a1a5-344e59aa2db4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:46.082635 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac453ce0-1845-4d97-a1a5-344e59aa2db4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:46.083135 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac453ce0-1845-4d97-a1a5-344e59aa2db4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:46.084122 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac453ce0-1845-4d97-a1a5-344e59aa2db4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:46.084588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac453ce0-1845-4d97-a1a5-344e59aa2db4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:46.125332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e6ffcfd2-bbf1-4609-a9d2-8de49b874b55 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.304159 Feb 17 03:29:46.126147 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 186/378] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:45 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:29:46.133020 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2631ec43-05d8-4d3b-8ce4-de945e26cd20 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:46.133929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2631ec43-05d8-4d3b-8ce4-de945e26cd20 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:46.143934 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2631ec43-05d8-4d3b-8ce4-de945e26cd20 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:46.144554 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2631ec43-05d8-4d3b-8ce4-de945e26cd20 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:46.145473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2631ec43-05d8-4d3b-8ce4-de945e26cd20 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:46.145975 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2631ec43-05d8-4d3b-8ce4-de945e26cd20 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:46.235697 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ac453ce0-1845-4d97-a1a5-344e59aa2db4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.166191 Feb 17 03:29:46.236628 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 193/379] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:46 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:46.407131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2631ec43-05d8-4d3b-8ce4-de945e26cd20 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:46.423125 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2631ec43-05d8-4d3b-8ce4-de945e26cd20 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.295245 Feb 17 03:29:46.423916 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 187/380] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:46 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:47.088847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-95132d39-8702-4382-ad37-1cf83d645d96 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:47.089656 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-95132d39-8702-4382-ad37-1cf83d645d96 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:47.098207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95132d39-8702-4382-ad37-1cf83d645d96 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:47.098649 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95132d39-8702-4382-ad37-1cf83d645d96 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:47.099480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95132d39-8702-4382-ad37-1cf83d645d96 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:47.099965 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95132d39-8702-4382-ad37-1cf83d645d96 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:47.138952 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-58641053-1396-45b9-b056-32aa65281866 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:47.140380 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-58641053-1396-45b9-b056-32aa65281866 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:47.148661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-58641053-1396-45b9-b056-32aa65281866 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:47.149312 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-58641053-1396-45b9-b056-32aa65281866 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:47.150356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-58641053-1396-45b9-b056-32aa65281866 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:47.151032 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-58641053-1396-45b9-b056-32aa65281866 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:47.323308 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-95132d39-8702-4382-ad37-1cf83d645d96 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:47.332188 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-95132d39-8702-4382-ad37-1cf83d645d96 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.248204 Feb 17 03:29:47.333088 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 194/381] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:47 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:47.338031 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ff5e885e-23d7-4bd0-a6f5-b41f8c3f4981 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:47.339048 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ff5e885e-23d7-4bd0-a6f5-b41f8c3f4981 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:47.346741 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ff5e885e-23d7-4bd0-a6f5-b41f8c3f4981 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:47.347239 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ff5e885e-23d7-4bd0-a6f5-b41f8c3f4981 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:47.348168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ff5e885e-23d7-4bd0-a6f5-b41f8c3f4981 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:47.348704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ff5e885e-23d7-4bd0-a6f5-b41f8c3f4981 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:47.423722 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-58641053-1396-45b9-b056-32aa65281866 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.288531 Feb 17 03:29:47.424411 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 188/382] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:47 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:29:47.444924 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-faac6346-c78a-4400-bf1b-a8491aa8ccc1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:47.445923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-faac6346-c78a-4400-bf1b-a8491aa8ccc1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:47.454485 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-faac6346-c78a-4400-bf1b-a8491aa8ccc1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:47.455005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-faac6346-c78a-4400-bf1b-a8491aa8ccc1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:47.455983 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-faac6346-c78a-4400-bf1b-a8491aa8ccc1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:47.456482 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-faac6346-c78a-4400-bf1b-a8491aa8ccc1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:47.494370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ff5e885e-23d7-4bd0-a6f5-b41f8c3f4981 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.159755 Feb 17 03:29:47.496757 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 195/383] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:47 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:47.703880 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-faac6346-c78a-4400-bf1b-a8491aa8ccc1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:47.715049 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-faac6346-c78a-4400-bf1b-a8491aa8ccc1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.274993 Feb 17 03:29:47.715889 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 189/384] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:47 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:48.350902 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-81f5e6cd-831b-4a83-9a30-b282525a6be6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:48.351638 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-81f5e6cd-831b-4a83-9a30-b282525a6be6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:48.360155 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-81f5e6cd-831b-4a83-9a30-b282525a6be6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:48.360661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-81f5e6cd-831b-4a83-9a30-b282525a6be6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:48.361529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-81f5e6cd-831b-4a83-9a30-b282525a6be6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:48.362026 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-81f5e6cd-831b-4a83-9a30-b282525a6be6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:48.436725 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ea5e135b-795e-49f3-b19b-ff835ab77a31 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:48.438028 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ea5e135b-795e-49f3-b19b-ff835ab77a31 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:48.447288 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea5e135b-795e-49f3-b19b-ff835ab77a31 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:48.447862 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea5e135b-795e-49f3-b19b-ff835ab77a31 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:48.448944 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea5e135b-795e-49f3-b19b-ff835ab77a31 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:48.449470 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea5e135b-795e-49f3-b19b-ff835ab77a31 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:48.583051 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-81f5e6cd-831b-4a83-9a30-b282525a6be6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:48.592279 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-81f5e6cd-831b-4a83-9a30-b282525a6be6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.245896 Feb 17 03:29:48.592875 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 196/385] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:48 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:48.597675 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-80f74dd8-d00b-4e53-99a3-9698e6dac8d2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:48.598870 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-80f74dd8-d00b-4e53-99a3-9698e6dac8d2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:48.607639 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-80f74dd8-d00b-4e53-99a3-9698e6dac8d2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:48.608179 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-80f74dd8-d00b-4e53-99a3-9698e6dac8d2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:48.609179 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-80f74dd8-d00b-4e53-99a3-9698e6dac8d2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:48.609680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-80f74dd8-d00b-4e53-99a3-9698e6dac8d2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:53.930000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-80f74dd8-d00b-4e53-99a3-9698e6dac8d2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 5.335692 Feb 17 03:29:53.931622 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 197/386] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:48 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 5338 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:53.936576 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e5d98409-199c-4078-a0af-19bf453825de tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:53.937364 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e5d98409-199c-4078-a0af-19bf453825de tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:53.947612 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5d98409-199c-4078-a0af-19bf453825de tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:53.948127 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5d98409-199c-4078-a0af-19bf453825de tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:53.948961 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ea5e135b-795e-49f3-b19b-ff835ab77a31 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 5.516292 Feb 17 03:29:53.949096 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5d98409-199c-4078-a0af-19bf453825de tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:53.949494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5d98409-199c-4078-a0af-19bf453825de tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:53.950044 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 190/387] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:48 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 5518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:29:53.954957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3f4b25f7-a0e1-40de-b498-5e372c01f466 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:53.955684 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3f4b25f7-a0e1-40de-b498-5e372c01f466 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:53.965159 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3f4b25f7-a0e1-40de-b498-5e372c01f466 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:53.965669 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3f4b25f7-a0e1-40de-b498-5e372c01f466 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:53.966513 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3f4b25f7-a0e1-40de-b498-5e372c01f466 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:53.967001 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3f4b25f7-a0e1-40de-b498-5e372c01f466 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:54.195226 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e5d98409-199c-4078-a0af-19bf453825de tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:54.203967 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3f4b25f7-a0e1-40de-b498-5e372c01f466 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:54.204348 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e5d98409-199c-4078-a0af-19bf453825de tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.272009 Feb 17 03:29:54.204951 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 198/388] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:53 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:54.213512 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3f4b25f7-a0e1-40de-b498-5e372c01f466 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.262596 Feb 17 03:29:54.214340 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 191/389] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:53 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:54.942375 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-48fdebf4-26ff-46c0-b63f-13e0906d4430 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:54.943425 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-48fdebf4-26ff-46c0-b63f-13e0906d4430 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:54.952567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-48fdebf4-26ff-46c0-b63f-13e0906d4430 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:54.953096 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-48fdebf4-26ff-46c0-b63f-13e0906d4430 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:54.953930 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-48fdebf4-26ff-46c0-b63f-13e0906d4430 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:54.954465 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-48fdebf4-26ff-46c0-b63f-13e0906d4430 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:54.961200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-19a8ddb9-6b53-4d3a-8272-5cf93d14b1cb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:54.962296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-19a8ddb9-6b53-4d3a-8272-5cf93d14b1cb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:54.971137 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-19a8ddb9-6b53-4d3a-8272-5cf93d14b1cb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:54.971640 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-19a8ddb9-6b53-4d3a-8272-5cf93d14b1cb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:54.972481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-19a8ddb9-6b53-4d3a-8272-5cf93d14b1cb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:54.972975 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-19a8ddb9-6b53-4d3a-8272-5cf93d14b1cb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:55.097983 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-48fdebf4-26ff-46c0-b63f-13e0906d4430 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.159491 Feb 17 03:29:55.098875 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 199/390] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:54 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:55.144210 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-19a8ddb9-6b53-4d3a-8272-5cf93d14b1cb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.186834 Feb 17 03:29:55.145208 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 192/391] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:54 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:29:55.223131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ea743c36-9043-4437-a9a2-099e355fd7eb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:55.223900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ea743c36-9043-4437-a9a2-099e355fd7eb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:55.233175 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cad5bf5c-ee10-43bc-830f-53d0cf4a48ad tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:55.233431 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea743c36-9043-4437-a9a2-099e355fd7eb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:55.233951 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea743c36-9043-4437-a9a2-099e355fd7eb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:55.234089 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cad5bf5c-ee10-43bc-830f-53d0cf4a48ad tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:55.234794 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea743c36-9043-4437-a9a2-099e355fd7eb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:55.235295 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ea743c36-9043-4437-a9a2-099e355fd7eb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:55.242595 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cad5bf5c-ee10-43bc-830f-53d0cf4a48ad tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:55.243107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cad5bf5c-ee10-43bc-830f-53d0cf4a48ad tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:55.243949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cad5bf5c-ee10-43bc-830f-53d0cf4a48ad tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:55.244440 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cad5bf5c-ee10-43bc-830f-53d0cf4a48ad tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:55.466909 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ea743c36-9043-4437-a9a2-099e355fd7eb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:55.475858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ea743c36-9043-4437-a9a2-099e355fd7eb tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.257308 Feb 17 03:29:55.476451 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 200/392] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:55 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:55.490811 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-cad5bf5c-ee10-43bc-830f-53d0cf4a48ad tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:55.499878 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cad5bf5c-ee10-43bc-830f-53d0cf4a48ad tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.271137 Feb 17 03:29:55.500518 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 193/393] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:55 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:56.111044 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-abca284d-bad9-449c-9997-0a6b7c0a6b08 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:56.112093 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-abca284d-bad9-449c-9997-0a6b7c0a6b08 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:56.120032 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-abca284d-bad9-449c-9997-0a6b7c0a6b08 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:56.120543 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-abca284d-bad9-449c-9997-0a6b7c0a6b08 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:56.121413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-abca284d-bad9-449c-9997-0a6b7c0a6b08 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:56.121916 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-abca284d-bad9-449c-9997-0a6b7c0a6b08 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:56.157089 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3204c58d-66f1-41b1-a5b1-d0d2b09f2fa1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:56.158193 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3204c58d-66f1-41b1-a5b1-d0d2b09f2fa1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:56.166642 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3204c58d-66f1-41b1-a5b1-d0d2b09f2fa1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:56.167086 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3204c58d-66f1-41b1-a5b1-d0d2b09f2fa1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:56.167931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3204c58d-66f1-41b1-a5b1-d0d2b09f2fa1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:56.168428 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3204c58d-66f1-41b1-a5b1-d0d2b09f2fa1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:56.291032 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-abca284d-bad9-449c-9997-0a6b7c0a6b08 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.183781 Feb 17 03:29:56.292186 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 201/394] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:56 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:29:56.495166 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9cff3038-b20c-4b52-88a9-f85892f06e82 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:56.495925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9cff3038-b20c-4b52-88a9-f85892f06e82 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:56.504345 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9cff3038-b20c-4b52-88a9-f85892f06e82 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:56.504823 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9cff3038-b20c-4b52-88a9-f85892f06e82 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:56.505679 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9cff3038-b20c-4b52-88a9-f85892f06e82 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:56.506171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9cff3038-b20c-4b52-88a9-f85892f06e82 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:56.556590 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3204c58d-66f1-41b1-a5b1-d0d2b09f2fa1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.403245 Feb 17 03:29:56.558203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 194/395] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:56 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:29:56.562747 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-af1a310b-fc05-4ba1-abd4-844754706762 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:29:56.563515 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-af1a310b-fc05-4ba1-abd4-844754706762 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:56.572847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-af1a310b-fc05-4ba1-abd4-844754706762 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:56.573359 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-af1a310b-fc05-4ba1-abd4-844754706762 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:56.574198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-af1a310b-fc05-4ba1-abd4-844754706762 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:56.574687 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-af1a310b-fc05-4ba1-abd4-844754706762 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:56.718355 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9cff3038-b20c-4b52-88a9-f85892f06e82 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:56.727331 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9cff3038-b20c-4b52-88a9-f85892f06e82 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.237260 Feb 17 03:29:56.727931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 202/396] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:56 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:56.788343 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-af1a310b-fc05-4ba1-abd4-844754706762 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:29:56.796980 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-af1a310b-fc05-4ba1-abd4-844754706762 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.238468 Feb 17 03:29:56.797600 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 195/397] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:29:56 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:29:57.303307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-49ac4fb1-7277-44ef-a319-ef8719a4cd16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:57.305059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-49ac4fb1-7277-44ef-a319-ef8719a4cd16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:57.313037 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-49ac4fb1-7277-44ef-a319-ef8719a4cd16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:57.313560 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-49ac4fb1-7277-44ef-a319-ef8719a4cd16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:57.314425 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-49ac4fb1-7277-44ef-a319-ef8719a4cd16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:57.314897 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-49ac4fb1-7277-44ef-a319-ef8719a4cd16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:57.569063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cdd4a353-41e9-4949-bda8-443592fb9fed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:29:57.571559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cdd4a353-41e9-4949-bda8-443592fb9fed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:29:57.580897 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cdd4a353-41e9-4949-bda8-443592fb9fed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:57.581443 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cdd4a353-41e9-4949-bda8-443592fb9fed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:29:57.582337 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cdd4a353-41e9-4949-bda8-443592fb9fed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:29:57.582825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cdd4a353-41e9-4949-bda8-443592fb9fed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:03.116150 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-49ac4fb1-7277-44ef-a319-ef8719a4cd16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 5.816610 Feb 17 03:30:03.118072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 203/398] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:29:57 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 5820 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:03.123607 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4db9ecf5-9df0-4e51-9161-5b8a0efe6341 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:03.124375 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4db9ecf5-9df0-4e51-9161-5b8a0efe6341 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:03.132934 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4db9ecf5-9df0-4e51-9161-5b8a0efe6341 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:03.133483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4db9ecf5-9df0-4e51-9161-5b8a0efe6341 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:03.134326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4db9ecf5-9df0-4e51-9161-5b8a0efe6341 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:03.134818 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4db9ecf5-9df0-4e51-9161-5b8a0efe6341 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:03.212291 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cdd4a353-41e9-4949-bda8-443592fb9fed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 5.647156 Feb 17 03:30:03.213098 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 196/399] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:29:57 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 5649 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:30:03.218822 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-da082a3a-d84c-49bb-b8b3-795104961054 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:03.219596 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-da082a3a-d84c-49bb-b8b3-795104961054 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:03.230335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da082a3a-d84c-49bb-b8b3-795104961054 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:03.230852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da082a3a-d84c-49bb-b8b3-795104961054 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:03.231758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da082a3a-d84c-49bb-b8b3-795104961054 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:03.232255 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da082a3a-d84c-49bb-b8b3-795104961054 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:03.356028 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4db9ecf5-9df0-4e51-9161-5b8a0efe6341 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:03.365793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4db9ecf5-9df0-4e51-9161-5b8a0efe6341 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.246229 Feb 17 03:30:03.366476 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 204/400] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:03 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:03.643975 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-da082a3a-d84c-49bb-b8b3-795104961054 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:03.653847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-da082a3a-d84c-49bb-b8b3-795104961054 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.439297 Feb 17 03:30:03.654452 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 197/401] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:03 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:04.129780 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-30bfa00b-54e0-44df-8c20-ac3719a286b0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:04.130813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-30bfa00b-54e0-44df-8c20-ac3719a286b0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:04.140156 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30bfa00b-54e0-44df-8c20-ac3719a286b0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:04.140655 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30bfa00b-54e0-44df-8c20-ac3719a286b0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:04.141511 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30bfa00b-54e0-44df-8c20-ac3719a286b0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:04.142050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30bfa00b-54e0-44df-8c20-ac3719a286b0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:04.224567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f8c5704a-22ba-498c-b282-5b1481713482 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:04.225646 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f8c5704a-22ba-498c-b282-5b1481713482 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:04.234754 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8c5704a-22ba-498c-b282-5b1481713482 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:04.235261 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8c5704a-22ba-498c-b282-5b1481713482 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:04.236166 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8c5704a-22ba-498c-b282-5b1481713482 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:04.236660 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8c5704a-22ba-498c-b282-5b1481713482 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:04.539875 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-30bfa00b-54e0-44df-8c20-ac3719a286b0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.413992 Feb 17 03:30:04.540572 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 205/402] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:04 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:04.545928 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-542996d2-304a-4012-9074-a041d070f51f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:04.546696 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-542996d2-304a-4012-9074-a041d070f51f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:04.555695 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-542996d2-304a-4012-9074-a041d070f51f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:04.556207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-542996d2-304a-4012-9074-a041d070f51f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:04.557062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-542996d2-304a-4012-9074-a041d070f51f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:04.557556 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-542996d2-304a-4012-9074-a041d070f51f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:04.642671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f8c5704a-22ba-498c-b282-5b1481713482 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.422144 Feb 17 03:30:04.643387 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 198/403] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:04 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:30:04.671948 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-baeb47e4-438e-44e0-a309-65ec7ec63570 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:04.672715 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-baeb47e4-438e-44e0-a309-65ec7ec63570 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:04.682008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-baeb47e4-438e-44e0-a309-65ec7ec63570 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:04.682515 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-baeb47e4-438e-44e0-a309-65ec7ec63570 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:04.683774 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-baeb47e4-438e-44e0-a309-65ec7ec63570 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:04.684246 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-baeb47e4-438e-44e0-a309-65ec7ec63570 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:04.779306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-542996d2-304a-4012-9074-a041d070f51f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:04.789530 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-542996d2-304a-4012-9074-a041d070f51f tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.247566 Feb 17 03:30:04.790336 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 206/404] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:04 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:04.920050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-baeb47e4-438e-44e0-a309-65ec7ec63570 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:04.929630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-baeb47e4-438e-44e0-a309-65ec7ec63570 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.261868 Feb 17 03:30:04.930236 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 199/405] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:04 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:05.552266 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8a3c3bab-cb27-4855-bae7-7b02b8e4be16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:05.553321 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8a3c3bab-cb27-4855-bae7-7b02b8e4be16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:05.562559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a3c3bab-cb27-4855-bae7-7b02b8e4be16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:05.563070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a3c3bab-cb27-4855-bae7-7b02b8e4be16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:05.563911 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a3c3bab-cb27-4855-bae7-7b02b8e4be16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:05.564411 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a3c3bab-cb27-4855-bae7-7b02b8e4be16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:05.654982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-82e37864-83eb-49ee-b3cb-d3097d98560e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:05.656011 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-82e37864-83eb-49ee-b3cb-d3097d98560e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:05.664604 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82e37864-83eb-49ee-b3cb-d3097d98560e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:05.665481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82e37864-83eb-49ee-b3cb-d3097d98560e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:05.666405 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82e37864-83eb-49ee-b3cb-d3097d98560e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:05.666889 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82e37864-83eb-49ee-b3cb-d3097d98560e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:05.721061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8a3c3bab-cb27-4855-bae7-7b02b8e4be16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.172637 Feb 17 03:30:05.722833 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 207/406] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:05 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:05.809521 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9d4cef5a-e185-49cc-8c71-fdc070e80f32 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:05.810221 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9d4cef5a-e185-49cc-8c71-fdc070e80f32 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:05.818931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9d4cef5a-e185-49cc-8c71-fdc070e80f32 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:05.820251 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9d4cef5a-e185-49cc-8c71-fdc070e80f32 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:05.821123 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9d4cef5a-e185-49cc-8c71-fdc070e80f32 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:05.821628 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9d4cef5a-e185-49cc-8c71-fdc070e80f32 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:05.899144 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-82e37864-83eb-49ee-b3cb-d3097d98560e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.247939 Feb 17 03:30:05.899869 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 200/407] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:05 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:30:05.948834 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-dd6de290-86ec-4f59-8d65-a4be7d8b97e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:05.949740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-dd6de290-86ec-4f59-8d65-a4be7d8b97e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:05.958657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dd6de290-86ec-4f59-8d65-a4be7d8b97e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:05.959251 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dd6de290-86ec-4f59-8d65-a4be7d8b97e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:05.960104 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dd6de290-86ec-4f59-8d65-a4be7d8b97e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:05.960598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dd6de290-86ec-4f59-8d65-a4be7d8b97e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:06.128380 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9d4cef5a-e185-49cc-8c71-fdc070e80f32 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:06.138394 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9d4cef5a-e185-49cc-8c71-fdc070e80f32 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.334322 Feb 17 03:30:06.138999 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 208/408] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:05 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:06.184760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dd6de290-86ec-4f59-8d65-a4be7d8b97e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:06.193680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-dd6de290-86ec-4f59-8d65-a4be7d8b97e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.249841 Feb 17 03:30:06.194783 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 201/409] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:05 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:06.733518 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cfb472ef-2e39-4cf6-8d1c-7551d876c18f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:06.734562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cfb472ef-2e39-4cf6-8d1c-7551d876c18f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:06.743636 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cfb472ef-2e39-4cf6-8d1c-7551d876c18f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:06.744452 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cfb472ef-2e39-4cf6-8d1c-7551d876c18f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:06.745524 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cfb472ef-2e39-4cf6-8d1c-7551d876c18f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:06.746118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cfb472ef-2e39-4cf6-8d1c-7551d876c18f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:06.911862 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4175c27e-0b65-47dc-b323-90a6f1b205c8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:06.912919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4175c27e-0b65-47dc-b323-90a6f1b205c8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:06.921262 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4175c27e-0b65-47dc-b323-90a6f1b205c8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:06.921774 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4175c27e-0b65-47dc-b323-90a6f1b205c8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:06.922615 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4175c27e-0b65-47dc-b323-90a6f1b205c8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:06.923110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4175c27e-0b65-47dc-b323-90a6f1b205c8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:07.007153 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cfb472ef-2e39-4cf6-8d1c-7551d876c18f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.277338 Feb 17 03:30:07.007760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 209/410] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:06 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:07.157969 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b8beacb4-0f44-410f-aaa8-4322ca921d46 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:07.158830 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b8beacb4-0f44-410f-aaa8-4322ca921d46 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:07.165714 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4175c27e-0b65-47dc-b323-90a6f1b205c8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.257804 Feb 17 03:30:07.167484 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 202/411] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:06 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:30:07.171664 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b8beacb4-0f44-410f-aaa8-4322ca921d46 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:07.172224 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b8beacb4-0f44-410f-aaa8-4322ca921d46 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:07.173350 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b8beacb4-0f44-410f-aaa8-4322ca921d46 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:07.173843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b8beacb4-0f44-410f-aaa8-4322ca921d46 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:07.213265 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5720bef8-54ba-4a27-bb72-ff916322adcc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:07.214325 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5720bef8-54ba-4a27-bb72-ff916322adcc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:07.222869 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5720bef8-54ba-4a27-bb72-ff916322adcc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:07.223386 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5720bef8-54ba-4a27-bb72-ff916322adcc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:07.224228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5720bef8-54ba-4a27-bb72-ff916322adcc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:07.224764 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5720bef8-54ba-4a27-bb72-ff916322adcc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:07.387437 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b8beacb4-0f44-410f-aaa8-4322ca921d46 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:07.396648 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b8beacb4-0f44-410f-aaa8-4322ca921d46 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.243273 Feb 17 03:30:07.397276 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 210/412] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:07 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:07.439576 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5720bef8-54ba-4a27-bb72-ff916322adcc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:07.449406 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5720bef8-54ba-4a27-bb72-ff916322adcc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.241174 Feb 17 03:30:07.450124 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 203/413] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:07 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:08.019605 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c681b1ac-ef16-49fb-a18e-fd3c8f47aa63 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:08.020654 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c681b1ac-ef16-49fb-a18e-fd3c8f47aa63 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:08.028583 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c681b1ac-ef16-49fb-a18e-fd3c8f47aa63 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:08.029114 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c681b1ac-ef16-49fb-a18e-fd3c8f47aa63 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:08.029950 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c681b1ac-ef16-49fb-a18e-fd3c8f47aa63 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:08.030441 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c681b1ac-ef16-49fb-a18e-fd3c8f47aa63 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:08.177616 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8a45a020-5e34-45f9-a9dd-d9bf871efe01 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:08.178657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8a45a020-5e34-45f9-a9dd-d9bf871efe01 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:08.188049 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a45a020-5e34-45f9-a9dd-d9bf871efe01 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:08.188553 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a45a020-5e34-45f9-a9dd-d9bf871efe01 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:08.189425 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a45a020-5e34-45f9-a9dd-d9bf871efe01 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:08.190060 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a45a020-5e34-45f9-a9dd-d9bf871efe01 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:08.346312 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c681b1ac-ef16-49fb-a18e-fd3c8f47aa63 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.330671 Feb 17 03:30:08.351024 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 211/414] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:08 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:08.397187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8a45a020-5e34-45f9-a9dd-d9bf871efe01 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.223634 Feb 17 03:30:08.398959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 204/415] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:08 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:30:08.416482 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-74f01f4f-3660-41a4-92b4-45532f52df6c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:08.417500 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-74f01f4f-3660-41a4-92b4-45532f52df6c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:08.425948 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-74f01f4f-3660-41a4-92b4-45532f52df6c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:08.426461 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-74f01f4f-3660-41a4-92b4-45532f52df6c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:08.427351 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-74f01f4f-3660-41a4-92b4-45532f52df6c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:08.427875 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-74f01f4f-3660-41a4-92b4-45532f52df6c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:08.467440 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7a18a9c1-39a2-459d-81d0-04bfd442da84 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:08.468250 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7a18a9c1-39a2-459d-81d0-04bfd442da84 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:08.477825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7a18a9c1-39a2-459d-81d0-04bfd442da84 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:08.478572 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7a18a9c1-39a2-459d-81d0-04bfd442da84 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:08.479637 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7a18a9c1-39a2-459d-81d0-04bfd442da84 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:08.480326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7a18a9c1-39a2-459d-81d0-04bfd442da84 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:08.714615 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-74f01f4f-3660-41a4-92b4-45532f52df6c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:08.726979 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-74f01f4f-3660-41a4-92b4-45532f52df6c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.313558 Feb 17 03:30:08.737160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 212/416] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:08 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:08.813356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7a18a9c1-39a2-459d-81d0-04bfd442da84 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:08.827474 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7a18a9c1-39a2-459d-81d0-04bfd442da84 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.364403 Feb 17 03:30:08.828308 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 205/417] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:08 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:09.359657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-84942d39-ca22-45ad-acbd-a247a2c0240c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:09.360850 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-84942d39-ca22-45ad-acbd-a247a2c0240c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:09.369694 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-84942d39-ca22-45ad-acbd-a247a2c0240c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:09.370290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-84942d39-ca22-45ad-acbd-a247a2c0240c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:09.371206 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-84942d39-ca22-45ad-acbd-a247a2c0240c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:09.371769 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-84942d39-ca22-45ad-acbd-a247a2c0240c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:09.410335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-558540c9-ad77-4464-9590-6be6545555fb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:09.411945 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-558540c9-ad77-4464-9590-6be6545555fb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:09.420828 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-558540c9-ad77-4464-9590-6be6545555fb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:09.421368 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-558540c9-ad77-4464-9590-6be6545555fb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:09.422218 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-558540c9-ad77-4464-9590-6be6545555fb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:09.422707 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-558540c9-ad77-4464-9590-6be6545555fb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:09.555538 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-84942d39-ca22-45ad-acbd-a247a2c0240c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.199765 Feb 17 03:30:09.556173 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 213/418] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:09 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:09.630386 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-558540c9-ad77-4464-9590-6be6545555fb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.224389 Feb 17 03:30:09.631087 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 206/419] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:09 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:30:09.745716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a2d06a8b-9bc2-4d90-b8c1-13054b2b158b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:09.746604 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a2d06a8b-9bc2-4d90-b8c1-13054b2b158b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:09.755295 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a2d06a8b-9bc2-4d90-b8c1-13054b2b158b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:09.755780 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a2d06a8b-9bc2-4d90-b8c1-13054b2b158b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:09.757361 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a2d06a8b-9bc2-4d90-b8c1-13054b2b158b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:09.757830 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a2d06a8b-9bc2-4d90-b8c1-13054b2b158b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:09.852633 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-60d90828-69d1-40ca-8f21-4dcf67ea36cf tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:09.854256 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-60d90828-69d1-40ca-8f21-4dcf67ea36cf tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:09.864297 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-60d90828-69d1-40ca-8f21-4dcf67ea36cf tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:09.865112 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-60d90828-69d1-40ca-8f21-4dcf67ea36cf tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:09.866149 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-60d90828-69d1-40ca-8f21-4dcf67ea36cf tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:09.866824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-60d90828-69d1-40ca-8f21-4dcf67ea36cf tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.021915 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a2d06a8b-9bc2-4d90-b8c1-13054b2b158b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:10.036102 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a2d06a8b-9bc2-4d90-b8c1-13054b2b158b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1500 microversion: 2.1 time: 0.294450 Feb 17 03:30:10.048488 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 214/420] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:09 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1500 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:10.054725 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-85b3a08c-5f00-4e8b-b478-900dedd187ad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a1fd28f-a737-4ddb-be51-2e0095caaa7b"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:10.061748 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-85b3a08c-5f00-4e8b-b478-900dedd187ad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:10.071412 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85b3a08c-5f00-4e8b-b478-900dedd187ad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:10.071922 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85b3a08c-5f00-4e8b-b478-900dedd187ad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.072779 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85b3a08c-5f00-4e8b-b478-900dedd187ad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:10.073618 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85b3a08c-5f00-4e8b-b478-900dedd187ad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.109788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-60d90828-69d1-40ca-8f21-4dcf67ea36cf tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:10.119170 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-60d90828-69d1-40ca-8f21-4dcf67ea36cf tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.270996 Feb 17 03:30:10.120108 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 207/421] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:09 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:10.126169 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-b9fc16f3-8b2e-4d8e-9176-e39de0366388 req-c9221bec-83fc-4846-a875-771455a8ed89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c691a18-0bdc-4921-9246-3de1981b4c2b", "name": "network-vif-plugged", "status": "completed", "tag": "a0f6513d-f485-4f7e-a35c-1db2dcf6b082"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:10.128162 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:30:10.128162 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:30:10.138807 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-b9fc16f3-8b2e-4d8e-9176-e39de0366388 req-c9221bec-83fc-4846-a875-771455a8ed89 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:10.139300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-b9fc16f3-8b2e-4d8e-9176-e39de0366388 req-c9221bec-83fc-4846-a875-771455a8ed89 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.140804 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-85b3a08c-5f00-4e8b-b478-900dedd187ad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] HTTP exception thrown: Cannot 'attach_volume' instance b4d58358-22a0-4562-9370-9574a29ec572 while it is in vm_state rescued Feb 17 03:30:10.141519 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-85b3a08c-5f00-4e8b-b478-900dedd187ad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Returning 409 to user: Cannot 'attach_volume' instance b4d58358-22a0-4562-9370-9574a29ec572 while it is in vm_state rescued {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:30:10.142472 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-85b3a08c-5f00-4e8b-b478-900dedd187ad tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "POST /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.092698 Feb 17 03:30:10.143262 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 215/422] 10.222.0.57 () {60 vars in 1313 bytes} [Wed Feb 17 03:30:10 2021] POST /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572/os-volume_attachments => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 17 03:30:10.151839 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a70d723e-cb5d-4f66-930b-16987aadab9d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:10.152423 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a70d723e-cb5d-4f66-930b-16987aadab9d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:10.158337 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-b9fc16f3-8b2e-4d8e-9176-e39de0366388 req-c9221bec-83fc-4846-a875-771455a8ed89 service nova] Creating event network-vif-plugged:a0f6513d-f485-4f7e-a35c-1db2dcf6b082 for instance 9c691a18-0bdc-4921-9246-3de1981b4c2b on hv-cinder-75994 Feb 17 03:30:10.160149 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a70d723e-cb5d-4f66-930b-16987aadab9d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:10.160657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a70d723e-cb5d-4f66-930b-16987aadab9d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.161527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a70d723e-cb5d-4f66-930b-16987aadab9d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:10.162020 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a70d723e-cb5d-4f66-930b-16987aadab9d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.163247 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-b9fc16f3-8b2e-4d8e-9176-e39de0366388 req-c9221bec-83fc-4846-a875-771455a8ed89 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040896 Feb 17 03:30:10.164022 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 208/423] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:30:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:30:10.308583 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a70d723e-cb5d-4f66-930b-16987aadab9d tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "POST /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572/action" status: 202 len: 0 microversion: 2.1 time: 0.160252 Feb 17 03:30:10.312709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 216/424] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:10 2021] POST /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:30:10.318673 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a49fd977-bfe7-4220-8fd0-c0595351b880 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:10.320009 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a49fd977-bfe7-4220-8fd0-c0595351b880 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:10.328284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a49fd977-bfe7-4220-8fd0-c0595351b880 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:10.328794 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a49fd977-bfe7-4220-8fd0-c0595351b880 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.329678 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a49fd977-bfe7-4220-8fd0-c0595351b880 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:10.330164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a49fd977-bfe7-4220-8fd0-c0595351b880 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.568688 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b0a243da-1995-4dcb-8546-44a7d464bebe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:10.570072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b0a243da-1995-4dcb-8546-44a7d464bebe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:10.578119 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b0a243da-1995-4dcb-8546-44a7d464bebe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:10.578688 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b0a243da-1995-4dcb-8546-44a7d464bebe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.579519 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b0a243da-1995-4dcb-8546-44a7d464bebe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:10.580159 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b0a243da-1995-4dcb-8546-44a7d464bebe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.583426 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a49fd977-bfe7-4220-8fd0-c0595351b880 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:10.593001 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a49fd977-bfe7-4220-8fd0-c0595351b880 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1508 microversion: 2.1 time: 0.278783 Feb 17 03:30:10.593651 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 209/425] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:10 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1508 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:30:10.643850 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1003f565-0cc8-4e36-8900-8499e21baa2c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:10.645547 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1003f565-0cc8-4e36-8900-8499e21baa2c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:10.654707 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1003f565-0cc8-4e36-8900-8499e21baa2c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:10.655430 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1003f565-0cc8-4e36-8900-8499e21baa2c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.656814 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1003f565-0cc8-4e36-8900-8499e21baa2c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:10.657418 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1003f565-0cc8-4e36-8900-8499e21baa2c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:10.743403 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b0a243da-1995-4dcb-8546-44a7d464bebe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.179167 Feb 17 03:30:10.745069 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 217/426] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:10 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:30:10.807260 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1003f565-0cc8-4e36-8900-8499e21baa2c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.167341 Feb 17 03:30:10.808771 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 210/427] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:10 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:30:11.138380 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3a0916f0-876c-4f34-89c1-62c1e0b8f0ec tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:11.139151 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3a0916f0-876c-4f34-89c1-62c1e0b8f0ec tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:11.148224 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3a0916f0-876c-4f34-89c1-62c1e0b8f0ec tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:11.148689 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3a0916f0-876c-4f34-89c1-62c1e0b8f0ec tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:11.149554 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3a0916f0-876c-4f34-89c1-62c1e0b8f0ec tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:11.150047 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3a0916f0-876c-4f34-89c1-62c1e0b8f0ec tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:11.368300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3a0916f0-876c-4f34-89c1-62c1e0b8f0ec tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:11.377160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3a0916f0-876c-4f34-89c1-62c1e0b8f0ec tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.243401 Feb 17 03:30:11.377760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 218/428] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:11 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:11.615363 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-45e138b5-0d8f-426f-a572-3a3c2dcb7529 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:11.617359 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-45e138b5-0d8f-426f-a572-3a3c2dcb7529 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:11.627074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45e138b5-0d8f-426f-a572-3a3c2dcb7529 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:11.627748 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45e138b5-0d8f-426f-a572-3a3c2dcb7529 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:11.628699 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45e138b5-0d8f-426f-a572-3a3c2dcb7529 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:11.629625 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45e138b5-0d8f-426f-a572-3a3c2dcb7529 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:11.756034 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c77e83d5-d045-4398-90b0-5797ad8af5d9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:11.758088 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c77e83d5-d045-4398-90b0-5797ad8af5d9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:11.766222 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c77e83d5-d045-4398-90b0-5797ad8af5d9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:11.766986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c77e83d5-d045-4398-90b0-5797ad8af5d9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:11.767934 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c77e83d5-d045-4398-90b0-5797ad8af5d9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:11.768530 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c77e83d5-d045-4398-90b0-5797ad8af5d9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:11.869413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-45e138b5-0d8f-426f-a572-3a3c2dcb7529 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:11.878513 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-45e138b5-0d8f-426f-a572-3a3c2dcb7529 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1508 microversion: 2.1 time: 0.268017 Feb 17 03:30:11.879221 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 211/429] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:11 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1508 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:11.886067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-29a24ae7-181b-47df-b714-ba22a814afe7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:11.887347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-29a24ae7-181b-47df-b714-ba22a814afe7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:11.895202 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-29a24ae7-181b-47df-b714-ba22a814afe7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:11.895803 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-29a24ae7-181b-47df-b714-ba22a814afe7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:11.896749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-29a24ae7-181b-47df-b714-ba22a814afe7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:11.897345 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-29a24ae7-181b-47df-b714-ba22a814afe7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:11.981671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c77e83d5-d045-4398-90b0-5797ad8af5d9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.229470 Feb 17 03:30:11.982653 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 219/430] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:11 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:12.095082 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-29a24ae7-181b-47df-b714-ba22a814afe7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.212506 Feb 17 03:30:12.095809 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 212/431] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:11 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:30:12.395618 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-93cffa99-754d-4016-907d-0136847de760 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:12.396379 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-93cffa99-754d-4016-907d-0136847de760 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:12.405762 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-93cffa99-754d-4016-907d-0136847de760 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:12.406259 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-93cffa99-754d-4016-907d-0136847de760 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:12.407108 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-93cffa99-754d-4016-907d-0136847de760 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:12.407592 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-93cffa99-754d-4016-907d-0136847de760 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:12.618201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-93cffa99-754d-4016-907d-0136847de760 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:12.627130 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-93cffa99-754d-4016-907d-0136847de760 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.236101 Feb 17 03:30:12.627725 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 220/432] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:12 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:12.896509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1e5f3139-2b31-445c-9a54-d53e8de5d127 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:12.898185 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1e5f3139-2b31-445c-9a54-d53e8de5d127 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:12.907097 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e5f3139-2b31-445c-9a54-d53e8de5d127 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:12.907689 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e5f3139-2b31-445c-9a54-d53e8de5d127 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:12.908640 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e5f3139-2b31-445c-9a54-d53e8de5d127 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:12.909236 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e5f3139-2b31-445c-9a54-d53e8de5d127 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:12.994480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-10371cf2-77cf-44ec-89fc-94b79135302a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:12.995511 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-10371cf2-77cf-44ec-89fc-94b79135302a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:13.003357 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-10371cf2-77cf-44ec-89fc-94b79135302a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:13.003857 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-10371cf2-77cf-44ec-89fc-94b79135302a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:13.004680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-10371cf2-77cf-44ec-89fc-94b79135302a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:13.005223 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-10371cf2-77cf-44ec-89fc-94b79135302a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:13.129945 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1e5f3139-2b31-445c-9a54-d53e8de5d127 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:13.139295 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1e5f3139-2b31-445c-9a54-d53e8de5d127 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1508 microversion: 2.1 time: 0.247303 Feb 17 03:30:13.139885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 213/433] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:12 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1508 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:13.144576 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7ada7cf8-9612-4a1e-818c-3a3c12ce9537 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:13.145623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7ada7cf8-9612-4a1e-818c-3a3c12ce9537 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:13.152982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7ada7cf8-9612-4a1e-818c-3a3c12ce9537 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:13.153540 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7ada7cf8-9612-4a1e-818c-3a3c12ce9537 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:13.154372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7ada7cf8-9612-4a1e-818c-3a3c12ce9537 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:13.154862 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7ada7cf8-9612-4a1e-818c-3a3c12ce9537 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:13.259491 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-10371cf2-77cf-44ec-89fc-94b79135302a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.269051 Feb 17 03:30:13.260153 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 221/434] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:12 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:13.417917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7ada7cf8-9612-4a1e-818c-3a3c12ce9537 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.276588 Feb 17 03:30:13.418626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 214/435] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:13 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:30:13.645348 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7f1cd2d1-9c4c-4e70-8a9c-f500333bf26d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:13.646110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7f1cd2d1-9c4c-4e70-8a9c-f500333bf26d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:13.654697 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f1cd2d1-9c4c-4e70-8a9c-f500333bf26d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:13.655208 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f1cd2d1-9c4c-4e70-8a9c-f500333bf26d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:13.656036 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f1cd2d1-9c4c-4e70-8a9c-f500333bf26d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:13.656526 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f1cd2d1-9c4c-4e70-8a9c-f500333bf26d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:13.869654 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7f1cd2d1-9c4c-4e70-8a9c-f500333bf26d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:13.878776 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7f1cd2d1-9c4c-4e70-8a9c-f500333bf26d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.237961 Feb 17 03:30:13.879458 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 222/436] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:13 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:14.158020 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-368dc869-e596-4b5a-952c-5c4ff833d07b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:14.158781 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-368dc869-e596-4b5a-952c-5c4ff833d07b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:14.167199 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-368dc869-e596-4b5a-952c-5c4ff833d07b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:14.167706 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-368dc869-e596-4b5a-952c-5c4ff833d07b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:14.168536 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-368dc869-e596-4b5a-952c-5c4ff833d07b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:14.169018 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-368dc869-e596-4b5a-952c-5c4ff833d07b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:14.272530 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-49e3ab59-e08a-4cce-ae58-aef956d73e17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:14.274225 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-49e3ab59-e08a-4cce-ae58-aef956d73e17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:14.282086 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-49e3ab59-e08a-4cce-ae58-aef956d73e17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:14.282592 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-49e3ab59-e08a-4cce-ae58-aef956d73e17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:14.283424 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-49e3ab59-e08a-4cce-ae58-aef956d73e17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:14.283931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-49e3ab59-e08a-4cce-ae58-aef956d73e17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:14.378243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-368dc869-e596-4b5a-952c-5c4ff833d07b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:14.387835 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-368dc869-e596-4b5a-952c-5c4ff833d07b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1508 microversion: 2.1 time: 0.234387 Feb 17 03:30:14.388419 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 215/437] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:14 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:14.429550 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-78dfb17d-1733-472b-a8ce-8c2cedabf516 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:14.430564 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-78dfb17d-1733-472b-a8ce-8c2cedabf516 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:14.437883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-78dfb17d-1733-472b-a8ce-8c2cedabf516 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:14.438382 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-78dfb17d-1733-472b-a8ce-8c2cedabf516 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:14.439212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-78dfb17d-1733-472b-a8ce-8c2cedabf516 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:14.439694 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-78dfb17d-1733-472b-a8ce-8c2cedabf516 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:19.483655 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-49e3ab59-e08a-4cce-ae58-aef956d73e17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 5.215032 Feb 17 03:30:19.487749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 223/438] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:14 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 5217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:19.490407 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c64c9b71-23a1-4c9f-abe0-02124b9ee3e5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:19.491169 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c64c9b71-23a1-4c9f-abe0-02124b9ee3e5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:19.500299 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c64c9b71-23a1-4c9f-abe0-02124b9ee3e5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:19.500811 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c64c9b71-23a1-4c9f-abe0-02124b9ee3e5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:19.501691 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c64c9b71-23a1-4c9f-abe0-02124b9ee3e5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:19.502184 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c64c9b71-23a1-4c9f-abe0-02124b9ee3e5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:19.509641 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-78dfb17d-1733-472b-a8ce-8c2cedabf516 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 5.083336 Feb 17 03:30:19.510582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 216/439] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:14 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 5085 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:30:19.519561 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7442df96-a8ba-440c-9a82-de4d65bd9a1e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:19.520321 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7442df96-a8ba-440c-9a82-de4d65bd9a1e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:19.528925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7442df96-a8ba-440c-9a82-de4d65bd9a1e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:19.529426 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7442df96-a8ba-440c-9a82-de4d65bd9a1e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:19.530262 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7442df96-a8ba-440c-9a82-de4d65bd9a1e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:19.531113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7442df96-a8ba-440c-9a82-de4d65bd9a1e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:19.770132 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7442df96-a8ba-440c-9a82-de4d65bd9a1e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:19.789790 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7442df96-a8ba-440c-9a82-de4d65bd9a1e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1508 microversion: 2.1 time: 0.273720 Feb 17 03:30:19.790571 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 217/440] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:19 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1508 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:20.180736 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c64c9b71-23a1-4c9f-abe0-02124b9ee3e5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:20.189671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c64c9b71-23a1-4c9f-abe0-02124b9ee3e5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1318 microversion: 2.1 time: 0.703460 Feb 17 03:30:20.190267 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 224/441] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:19 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1318 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:20.496356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b91675b2-7e3d-4aac-8644-04ef139df63f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:20.497432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b91675b2-7e3d-4aac-8644-04ef139df63f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:20.505283 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b91675b2-7e3d-4aac-8644-04ef139df63f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:20.505790 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b91675b2-7e3d-4aac-8644-04ef139df63f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:20.506622 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b91675b2-7e3d-4aac-8644-04ef139df63f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:20.507115 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b91675b2-7e3d-4aac-8644-04ef139df63f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:20.521828 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ffe3069b-56ee-4b88-b241-b4dd81776b4b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:20.523036 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ffe3069b-56ee-4b88-b241-b4dd81776b4b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:20.531424 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ffe3069b-56ee-4b88-b241-b4dd81776b4b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:20.531923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ffe3069b-56ee-4b88-b241-b4dd81776b4b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:20.532798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ffe3069b-56ee-4b88-b241-b4dd81776b4b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:20.533310 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ffe3069b-56ee-4b88-b241-b4dd81776b4b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:20.950332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b91675b2-7e3d-4aac-8644-04ef139df63f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.458328 Feb 17 03:30:20.951021 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 218/442] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:20 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:20.956993 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-628eb9e4-c7d6-48b3-8654-2a6970a0bcea tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:20.957885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-628eb9e4-c7d6-48b3-8654-2a6970a0bcea tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:20.966177 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ffe3069b-56ee-4b88-b241-b4dd81776b4b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.447994 Feb 17 03:30:20.966793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-628eb9e4-c7d6-48b3-8654-2a6970a0bcea tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:20.966938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 225/443] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:20 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:30:20.967441 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-628eb9e4-c7d6-48b3-8654-2a6970a0bcea tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:20.968497 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-628eb9e4-c7d6-48b3-8654-2a6970a0bcea tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:20.969061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-628eb9e4-c7d6-48b3-8654-2a6970a0bcea tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:21.190263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-628eb9e4-c7d6-48b3-8654-2a6970a0bcea tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:21.199448 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-628eb9e4-c7d6-48b3-8654-2a6970a0bcea tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1508 microversion: 2.1 time: 0.246657 Feb 17 03:30:21.200212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 219/444] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:20 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1508 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:21.208710 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-73128db4-17f0-4991-8ce2-0373ede5c523 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:21.209926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-73128db4-17f0-4991-8ce2-0373ede5c523 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:21.219119 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73128db4-17f0-4991-8ce2-0373ede5c523 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:21.219749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73128db4-17f0-4991-8ce2-0373ede5c523 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:21.220598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73128db4-17f0-4991-8ce2-0373ede5c523 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:21.221137 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73128db4-17f0-4991-8ce2-0373ede5c523 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:21.449541 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-73128db4-17f0-4991-8ce2-0373ede5c523 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:21.458917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-73128db4-17f0-4991-8ce2-0373ede5c523 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1508 microversion: 2.1 time: 0.254503 Feb 17 03:30:21.472108 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 226/445] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:21 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:21.963431 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-42d5e2ba-93e9-484f-ae1f-9ba0c3e5a94d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:21.965018 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-42d5e2ba-93e9-484f-ae1f-9ba0c3e5a94d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:21.974563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-42d5e2ba-93e9-484f-ae1f-9ba0c3e5a94d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:21.975081 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-42d5e2ba-93e9-484f-ae1f-9ba0c3e5a94d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:21.975940 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-42d5e2ba-93e9-484f-ae1f-9ba0c3e5a94d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:21.976636 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-42d5e2ba-93e9-484f-ae1f-9ba0c3e5a94d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:21.979358 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-eebb6cb8-3d27-4789-960f-45dfc88fcc4c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:21.980481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-eebb6cb8-3d27-4789-960f-45dfc88fcc4c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:21.988879 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eebb6cb8-3d27-4789-960f-45dfc88fcc4c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:21.989480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eebb6cb8-3d27-4789-960f-45dfc88fcc4c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:21.990373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eebb6cb8-3d27-4789-960f-45dfc88fcc4c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:21.990941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eebb6cb8-3d27-4789-960f-45dfc88fcc4c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:22.282361 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-eebb6cb8-3d27-4789-960f-45dfc88fcc4c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.307436 Feb 17 03:30:22.282999 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 227/446] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:21 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:30:22.288243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a9c32df7-458c-46aa-8716-31532a9b1ee6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:22.289010 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a9c32df7-458c-46aa-8716-31532a9b1ee6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:22.297429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a9c32df7-458c-46aa-8716-31532a9b1ee6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:22.297935 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a9c32df7-458c-46aa-8716-31532a9b1ee6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:22.298768 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a9c32df7-458c-46aa-8716-31532a9b1ee6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:22.299263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a9c32df7-458c-46aa-8716-31532a9b1ee6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:22.309992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-42d5e2ba-93e9-484f-ae1f-9ba0c3e5a94d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28146 microversion: 2.20 time: 0.351072 Feb 17 03:30:22.314131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 220/447] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:21 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28146 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:22.510028 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a9c32df7-458c-46aa-8716-31532a9b1ee6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:22.518777 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a9c32df7-458c-46aa-8716-31532a9b1ee6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1508 microversion: 2.1 time: 0.234587 Feb 17 03:30:22.519365 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 228/448] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:22 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:23.295273 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0a4b5c47-1266-434f-ba58-3c2e51ef40a0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:23.296536 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0a4b5c47-1266-434f-ba58-3c2e51ef40a0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:23.305062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a4b5c47-1266-434f-ba58-3c2e51ef40a0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:23.305564 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a4b5c47-1266-434f-ba58-3c2e51ef40a0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:23.306433 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a4b5c47-1266-434f-ba58-3c2e51ef40a0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:23.306914 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a4b5c47-1266-434f-ba58-3c2e51ef40a0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:23.323092 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-07e3123a-36d6-47d4-8726-8cac519477ad tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:23.324172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-07e3123a-36d6-47d4-8726-8cac519477ad tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:23.333072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07e3123a-36d6-47d4-8726-8cac519477ad tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:23.333583 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07e3123a-36d6-47d4-8726-8cac519477ad tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:23.334425 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07e3123a-36d6-47d4-8726-8cac519477ad tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:23.334981 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07e3123a-36d6-47d4-8726-8cac519477ad tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:23.596996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0a4b5c47-1266-434f-ba58-3c2e51ef40a0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28112 microversion: 2.1 time: 0.306004 Feb 17 03:30:23.597723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 221/449] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:23 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28112 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:30:23.603028 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1468bcd1-8b8a-421d-820c-522b39872225 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:23.603792 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1468bcd1-8b8a-421d-820c-522b39872225 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:23.612021 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1468bcd1-8b8a-421d-820c-522b39872225 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:23.612522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1468bcd1-8b8a-421d-820c-522b39872225 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:23.613371 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1468bcd1-8b8a-421d-820c-522b39872225 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:23.613891 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1468bcd1-8b8a-421d-820c-522b39872225 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:23.697948 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-07e3123a-36d6-47d4-8726-8cac519477ad tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28357 microversion: 2.20 time: 0.379456 Feb 17 03:30:23.699967 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 229/450] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:23 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28357 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:30:23.843774 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1468bcd1-8b8a-421d-820c-522b39872225 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:23.853497 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1468bcd1-8b8a-421d-820c-522b39872225 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1508 microversion: 2.1 time: 0.254438 Feb 17 03:30:23.854378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 222/451] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:23 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:24.610032 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e83ea37f-55a1-4e55-a98d-5a93c8e194d8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:24.611121 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e83ea37f-55a1-4e55-a98d-5a93c8e194d8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:24.619505 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e83ea37f-55a1-4e55-a98d-5a93c8e194d8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:24.620010 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e83ea37f-55a1-4e55-a98d-5a93c8e194d8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:24.620836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e83ea37f-55a1-4e55-a98d-5a93c8e194d8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:24.621345 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e83ea37f-55a1-4e55-a98d-5a93c8e194d8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:24.711212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2b83c51b-0cfa-473b-8847-a23a88be8183 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:24.712878 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2b83c51b-0cfa-473b-8847-a23a88be8183 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:24.721062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2b83c51b-0cfa-473b-8847-a23a88be8183 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:24.721588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2b83c51b-0cfa-473b-8847-a23a88be8183 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:24.722428 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2b83c51b-0cfa-473b-8847-a23a88be8183 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:24.722923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2b83c51b-0cfa-473b-8847-a23a88be8183 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:24.806022 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e83ea37f-55a1-4e55-a98d-5a93c8e194d8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28402 microversion: 2.1 time: 0.200278 Feb 17 03:30:24.806718 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 230/452] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:24 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28402 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:30:24.872626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f9edc61f-bcbd-4fa0-9d6a-ec61064fd755 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:24.873413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f9edc61f-bcbd-4fa0-9d6a-ec61064fd755 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:24.882795 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f9edc61f-bcbd-4fa0-9d6a-ec61064fd755 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:24.883300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f9edc61f-bcbd-4fa0-9d6a-ec61064fd755 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:24.884808 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f9edc61f-bcbd-4fa0-9d6a-ec61064fd755 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:24.885300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f9edc61f-bcbd-4fa0-9d6a-ec61064fd755 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:24.954312 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2b83c51b-0cfa-473b-8847-a23a88be8183 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28435 microversion: 2.20 time: 0.246943 Feb 17 03:30:24.955013 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 223/453] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:24 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28435 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:30:25.099024 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f9edc61f-bcbd-4fa0-9d6a-ec61064fd755 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:25.107925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f9edc61f-bcbd-4fa0-9d6a-ec61064fd755 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1514 microversion: 2.1 time: 0.240547 Feb 17 03:30:25.108531 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 231/454] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:24 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:25.227297 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-38e18384-d7af-4373-bdec-a8530273fcd3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a312cc28-957b-497c-8e7e-8974480e2b16", "device": "/dev/sdb"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:25.229149 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-38e18384-d7af-4373-bdec-a8530273fcd3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:25.237588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-38e18384-d7af-4373-bdec-a8530273fcd3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:25.238100 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-38e18384-d7af-4373-bdec-a8530273fcd3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:25.239269 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-38e18384-d7af-4373-bdec-a8530273fcd3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:25.239384 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-38e18384-d7af-4373-bdec-a8530273fcd3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:25.328331 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6215e7d3-e320-4c00-a1a6-56c48787941e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "322c87fe-f1c4-41c1-9d07-7e35d9cf8359"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:25.329606 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6215e7d3-e320-4c00-a1a6-56c48787941e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:25.338631 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6215e7d3-e320-4c00-a1a6-56c48787941e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:25.339117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6215e7d3-e320-4c00-a1a6-56c48787941e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:25.340620 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6215e7d3-e320-4c00-a1a6-56c48787941e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:25.341297 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6215e7d3-e320-4c00-a1a6-56c48787941e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:25.754838 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-38e18384-d7af-4373-bdec-a8530273fcd3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "POST /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.531797 Feb 17 03:30:25.756025 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 224/455] 10.222.0.57 () {60 vars in 1313 bytes} [Wed Feb 17 03:30:25 2021] POST /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963/os-volume_attachments => generated 194 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:30:25.819931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2e4deff4-710d-463f-865a-dc37b45011fa tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:25.821471 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2e4deff4-710d-463f-865a-dc37b45011fa tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:25.831399 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e4deff4-710d-463f-865a-dc37b45011fa tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:25.832131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e4deff4-710d-463f-865a-dc37b45011fa tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:25.833182 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e4deff4-710d-463f-865a-dc37b45011fa tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:25.833856 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e4deff4-710d-463f-865a-dc37b45011fa tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:25.927158 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6215e7d3-e320-4c00-a1a6-56c48787941e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "POST /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.602674 Feb 17 03:30:25.927955 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 232/456] 10.222.0.57 () {60 vars in 1313 bytes} [Wed Feb 17 03:30:25 2021] POST /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b/os-volume_attachments => generated 194 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:30:25.970268 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2e4deff4-710d-463f-865a-dc37b45011fa tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28402 microversion: 2.1 time: 0.155311 Feb 17 03:30:25.970990 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 225/457] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:25 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28402 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:30:25.975200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6333fde9-21a4-48ba-affd-77ed746f8a21 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:25.976897 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6333fde9-21a4-48ba-affd-77ed746f8a21 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:26.003801 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6333fde9-21a4-48ba-affd-77ed746f8a21 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:26.004309 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6333fde9-21a4-48ba-affd-77ed746f8a21 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:26.005200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6333fde9-21a4-48ba-affd-77ed746f8a21 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:26.005942 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6333fde9-21a4-48ba-affd-77ed746f8a21 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:26.205442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6333fde9-21a4-48ba-affd-77ed746f8a21 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28435 microversion: 2.20 time: 0.242337 Feb 17 03:30:26.206410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 233/458] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:25 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28435 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:30:26.983882 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0aeb27d0-e8da-43ac-bdbc-8a15dd93b8d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:26.985056 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0aeb27d0-e8da-43ac-bdbc-8a15dd93b8d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:26.993607 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0aeb27d0-e8da-43ac-bdbc-8a15dd93b8d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:26.994110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0aeb27d0-e8da-43ac-bdbc-8a15dd93b8d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:26.994953 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0aeb27d0-e8da-43ac-bdbc-8a15dd93b8d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:26.995442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0aeb27d0-e8da-43ac-bdbc-8a15dd93b8d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:27.146608 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0aeb27d0-e8da-43ac-bdbc-8a15dd93b8d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28402 microversion: 2.1 time: 0.167227 Feb 17 03:30:27.151287 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 226/459] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:26 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28402 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:30:27.219027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-dbfaceb6-86e9-4144-bf63-f24e7ef02cb0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:27.220172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-dbfaceb6-86e9-4144-bf63-f24e7ef02cb0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:27.228808 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dbfaceb6-86e9-4144-bf63-f24e7ef02cb0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:27.229348 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dbfaceb6-86e9-4144-bf63-f24e7ef02cb0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:27.230185 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dbfaceb6-86e9-4144-bf63-f24e7ef02cb0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:27.230724 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dbfaceb6-86e9-4144-bf63-f24e7ef02cb0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:27.411701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-dbfaceb6-86e9-4144-bf63-f24e7ef02cb0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.197101 Feb 17 03:30:27.413022 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 234/460] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:27 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:27.936016 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8c2b3f68-bfe6-42e1-8531-2a6dda658c63 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:30:27.936788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8c2b3f68-bfe6-42e1-8531-2a6dda658c63 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:27.945653 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8c2b3f68-bfe6-42e1-8531-2a6dda658c63 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:27.946780 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8c2b3f68-bfe6-42e1-8531-2a6dda658c63 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:27.947629 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8c2b3f68-bfe6-42e1-8531-2a6dda658c63 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:27.948121 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8c2b3f68-bfe6-42e1-8531-2a6dda658c63 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:28.160219 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-06c67fc9-e080-44f5-bfbf-ce90e25d42ec tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:28.161402 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-06c67fc9-e080-44f5-bfbf-ce90e25d42ec tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:28.195203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-06c67fc9-e080-44f5-bfbf-ce90e25d42ec tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:28.196578 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-06c67fc9-e080-44f5-bfbf-ce90e25d42ec tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:28.199144 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-06c67fc9-e080-44f5-bfbf-ce90e25d42ec tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:28.199842 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-06c67fc9-e080-44f5-bfbf-ce90e25d42ec tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:28.205453 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8c2b3f68-bfe6-42e1-8531-2a6dda658c63 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:30:28.218368 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8c2b3f68-bfe6-42e1-8531-2a6dda658c63 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1514 microversion: 2.1 time: 0.286330 Feb 17 03:30:28.219505 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 227/461] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:30:27 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1514 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:30:28.236626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c3bf1d4a-1cd4-4b09-8e55-41f14c9ef099 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9be22d5c-de27-441f-bb4c-f65e9b205744"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:28.239455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c3bf1d4a-1cd4-4b09-8e55-41f14c9ef099 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:28.248063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3bf1d4a-1cd4-4b09-8e55-41f14c9ef099 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:28.248798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3bf1d4a-1cd4-4b09-8e55-41f14c9ef099 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:28.249765 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3bf1d4a-1cd4-4b09-8e55-41f14c9ef099 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:28.250345 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3bf1d4a-1cd4-4b09-8e55-41f14c9ef099 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:28.379609 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-06c67fc9-e080-44f5-bfbf-ce90e25d42ec tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.223540 Feb 17 03:30:28.380883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 235/462] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:28 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:30:28.425556 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-945ae99d-af51-4f73-8165-5b3064f0c350 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:28.426831 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-945ae99d-af51-4f73-8165-5b3064f0c350 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:28.437342 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-945ae99d-af51-4f73-8165-5b3064f0c350 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:28.437926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-945ae99d-af51-4f73-8165-5b3064f0c350 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:28.439013 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-945ae99d-af51-4f73-8165-5b3064f0c350 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:28.439560 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-945ae99d-af51-4f73-8165-5b3064f0c350 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:28.615820 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-945ae99d-af51-4f73-8165-5b3064f0c350 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.195238 Feb 17 03:30:28.616752 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 236/463] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:28 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:30:28.721666 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c3bf1d4a-1cd4-4b09-8e55-41f14c9ef099 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "POST /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.489694 Feb 17 03:30:28.722427 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 228/464] 10.222.0.57 () {60 vars in 1313 bytes} [Wed Feb 17 03:30:28 2021] POST /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572/os-volume_attachments => generated 194 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:30:29.395098 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fdeb933c-e33b-41d2-96ff-4b98db3390a0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:29.400584 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fdeb933c-e33b-41d2-96ff-4b98db3390a0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:29.413662 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fdeb933c-e33b-41d2-96ff-4b98db3390a0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:29.414409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fdeb933c-e33b-41d2-96ff-4b98db3390a0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:29.415974 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fdeb933c-e33b-41d2-96ff-4b98db3390a0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:29.416795 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fdeb933c-e33b-41d2-96ff-4b98db3390a0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:29.550867 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fdeb933c-e33b-41d2-96ff-4b98db3390a0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.162318 Feb 17 03:30:29.552039 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 237/465] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:29 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:30:29.629570 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ca009c8c-34d4-4c3b-912a-d7aa516bf8fd tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:29.630797 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ca009c8c-34d4-4c3b-912a-d7aa516bf8fd tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:29.639609 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca009c8c-34d4-4c3b-912a-d7aa516bf8fd tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:29.640126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca009c8c-34d4-4c3b-912a-d7aa516bf8fd tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:29.640967 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca009c8c-34d4-4c3b-912a-d7aa516bf8fd tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:29.641489 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca009c8c-34d4-4c3b-912a-d7aa516bf8fd tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:29.775442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ca009c8c-34d4-4c3b-912a-d7aa516bf8fd tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.149513 Feb 17 03:30:29.777336 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 229/466] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:29 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:30:30.568512 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-653f11eb-60c6-4732-8025-cd5fde71165b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:30.570836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-653f11eb-60c6-4732-8025-cd5fde71165b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:30.580423 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-653f11eb-60c6-4732-8025-cd5fde71165b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:30.581153 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-653f11eb-60c6-4732-8025-cd5fde71165b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:30.582132 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-653f11eb-60c6-4732-8025-cd5fde71165b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:30.582701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-653f11eb-60c6-4732-8025-cd5fde71165b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:30.706041 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-653f11eb-60c6-4732-8025-cd5fde71165b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.145407 Feb 17 03:30:30.706975 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 238/467] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:30 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:30:30.788678 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b88ce5aa-dc45-4a52-abb3-f02c0423c249 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:30.790453 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b88ce5aa-dc45-4a52-abb3-f02c0423c249 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:30.799114 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b88ce5aa-dc45-4a52-abb3-f02c0423c249 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:30.799619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b88ce5aa-dc45-4a52-abb3-f02c0423c249 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:30.800460 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b88ce5aa-dc45-4a52-abb3-f02c0423c249 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:30.800948 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b88ce5aa-dc45-4a52-abb3-f02c0423c249 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:30.954602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b88ce5aa-dc45-4a52-abb3-f02c0423c249 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.170218 Feb 17 03:30:30.958854 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 230/468] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:30 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:31.719243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bc65887a-34d4-4fea-bb5a-6643a8e0c3d5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:31.720399 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bc65887a-34d4-4fea-bb5a-6643a8e0c3d5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:31.729287 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bc65887a-34d4-4fea-bb5a-6643a8e0c3d5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:31.729798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bc65887a-34d4-4fea-bb5a-6643a8e0c3d5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:31.730745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bc65887a-34d4-4fea-bb5a-6643a8e0c3d5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:31.731124 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bc65887a-34d4-4fea-bb5a-6643a8e0c3d5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:31.876591 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bc65887a-34d4-4fea-bb5a-6643a8e0c3d5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.161679 Feb 17 03:30:31.877301 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 239/469] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:31 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:30:31.967376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f50b6049-d293-485f-ae33-ab92956b860a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:31.968621 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f50b6049-d293-485f-ae33-ab92956b860a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:31.977353 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f50b6049-d293-485f-ae33-ab92956b860a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:31.977939 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f50b6049-d293-485f-ae33-ab92956b860a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:31.978837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f50b6049-d293-485f-ae33-ab92956b860a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:31.979412 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f50b6049-d293-485f-ae33-ab92956b860a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:32.247002 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f50b6049-d293-485f-ae33-ab92956b860a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.283960 Feb 17 03:30:32.247735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 231/470] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:31 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:32.890716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ba0f46f6-7268-416c-a589-5929478f7c32 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:32.891859 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ba0f46f6-7268-416c-a589-5929478f7c32 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:32.900771 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ba0f46f6-7268-416c-a589-5929478f7c32 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:32.901326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ba0f46f6-7268-416c-a589-5929478f7c32 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:32.902174 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ba0f46f6-7268-416c-a589-5929478f7c32 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:32.902660 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ba0f46f6-7268-416c-a589-5929478f7c32 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:33.260112 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-249f2061-95d4-486a-ac9a-8c30272e4909 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:33.261279 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-249f2061-95d4-486a-ac9a-8c30272e4909 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:33.269969 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-249f2061-95d4-486a-ac9a-8c30272e4909 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:33.270499 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-249f2061-95d4-486a-ac9a-8c30272e4909 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:33.271334 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-249f2061-95d4-486a-ac9a-8c30272e4909 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:33.271821 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-249f2061-95d4-486a-ac9a-8c30272e4909 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:33.276700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ba0f46f6-7268-416c-a589-5929478f7c32 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.390743 Feb 17 03:30:33.277409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 240/471] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:32 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:30:33.412766 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-249f2061-95d4-486a-ac9a-8c30272e4909 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.156944 Feb 17 03:30:33.413469 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 232/472] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:33 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:34.288843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d26cff13-ed1b-4a27-a6a7-de72114f244a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:34.290507 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d26cff13-ed1b-4a27-a6a7-de72114f244a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:34.299126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d26cff13-ed1b-4a27-a6a7-de72114f244a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:34.299634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d26cff13-ed1b-4a27-a6a7-de72114f244a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:34.300474 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d26cff13-ed1b-4a27-a6a7-de72114f244a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:34.300969 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d26cff13-ed1b-4a27-a6a7-de72114f244a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:34.426069 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d89f514d-4ca7-434b-8af5-79b39fe3484b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:34.427144 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d89f514d-4ca7-434b-8af5-79b39fe3484b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:34.436177 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d89f514d-4ca7-434b-8af5-79b39fe3484b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:34.436682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d89f514d-4ca7-434b-8af5-79b39fe3484b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:34.437536 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d89f514d-4ca7-434b-8af5-79b39fe3484b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:34.438023 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d89f514d-4ca7-434b-8af5-79b39fe3484b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:37.402061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d89f514d-4ca7-434b-8af5-79b39fe3484b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 2.980396 Feb 17 03:30:37.402774 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 233/473] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:34 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 2982 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:30:37.424124 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d26cff13-ed1b-4a27-a6a7-de72114f244a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 3.139623 Feb 17 03:30:37.424818 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 241/474] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:34 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 3142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:30:38.415058 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-149147ad-e8a5-4b40-ae2a-66596c340ca2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:38.416443 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-149147ad-e8a5-4b40-ae2a-66596c340ca2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:38.425201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-149147ad-e8a5-4b40-ae2a-66596c340ca2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:38.425836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-149147ad-e8a5-4b40-ae2a-66596c340ca2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:38.426756 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-149147ad-e8a5-4b40-ae2a-66596c340ca2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:38.427246 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-149147ad-e8a5-4b40-ae2a-66596c340ca2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:38.437934 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-73053655-db93-4e2b-a9cf-493388e3669f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:38.439236 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-73053655-db93-4e2b-a9cf-493388e3669f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:38.448307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73053655-db93-4e2b-a9cf-493388e3669f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:38.448814 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73053655-db93-4e2b-a9cf-493388e3669f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:38.449672 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73053655-db93-4e2b-a9cf-493388e3669f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:38.450163 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73053655-db93-4e2b-a9cf-493388e3669f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:38.623700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-149147ad-e8a5-4b40-ae2a-66596c340ca2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.212906 Feb 17 03:30:38.624412 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 234/475] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:38 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:38.666888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-73053655-db93-4e2b-a9cf-493388e3669f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.233754 Feb 17 03:30:38.667582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 242/476] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:38 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:30:39.636973 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9831d986-1c0e-42de-bcee-78d58d82ea0c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:39.638189 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9831d986-1c0e-42de-bcee-78d58d82ea0c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:39.646636 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9831d986-1c0e-42de-bcee-78d58d82ea0c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:39.647143 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9831d986-1c0e-42de-bcee-78d58d82ea0c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:39.647976 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9831d986-1c0e-42de-bcee-78d58d82ea0c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:39.648461 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9831d986-1c0e-42de-bcee-78d58d82ea0c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:39.680085 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-243fc352-8826-4424-8541-787810964146 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:39.681621 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-243fc352-8826-4424-8541-787810964146 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:39.690945 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-243fc352-8826-4424-8541-787810964146 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:39.691499 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-243fc352-8826-4424-8541-787810964146 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:39.692436 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-243fc352-8826-4424-8541-787810964146 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:39.693009 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-243fc352-8826-4424-8541-787810964146 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:44.194094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9831d986-1c0e-42de-bcee-78d58d82ea0c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 4.561916 Feb 17 03:30:44.195050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 235/477] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:39 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 4564 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:44.290516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-243fc352-8826-4424-8541-787810964146 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 4.614856 Feb 17 03:30:44.291212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 243/478] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:39 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 4617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:30:45.207824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-15812d9c-2c5e-4860-be7d-79367a1d62fd tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:45.208982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-15812d9c-2c5e-4860-be7d-79367a1d62fd tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:45.218105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-15812d9c-2c5e-4860-be7d-79367a1d62fd tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:45.218608 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-15812d9c-2c5e-4860-be7d-79367a1d62fd tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:45.219484 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-15812d9c-2c5e-4860-be7d-79367a1d62fd tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:45.219975 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-15812d9c-2c5e-4860-be7d-79367a1d62fd tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:45.303415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f38fd24e-0924-4d2c-a0e7-590859db8753 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:45.304562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f38fd24e-0924-4d2c-a0e7-590859db8753 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:45.312981 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f38fd24e-0924-4d2c-a0e7-590859db8753 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:45.313514 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f38fd24e-0924-4d2c-a0e7-590859db8753 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:45.314339 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f38fd24e-0924-4d2c-a0e7-590859db8753 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:45.314828 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f38fd24e-0924-4d2c-a0e7-590859db8753 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:45.356469 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-15812d9c-2c5e-4860-be7d-79367a1d62fd tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.153117 Feb 17 03:30:45.357342 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 236/479] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:45 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:45.454301 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f38fd24e-0924-4d2c-a0e7-590859db8753 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.155177 Feb 17 03:30:45.458332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 244/480] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:45 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:30:46.369557 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-afd1f6b4-bc49-464e-aed8-a47a7e149a15 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:46.370740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-afd1f6b4-bc49-464e-aed8-a47a7e149a15 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:46.379277 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-afd1f6b4-bc49-464e-aed8-a47a7e149a15 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:46.379783 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-afd1f6b4-bc49-464e-aed8-a47a7e149a15 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:46.380621 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-afd1f6b4-bc49-464e-aed8-a47a7e149a15 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:46.381180 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-afd1f6b4-bc49-464e-aed8-a47a7e149a15 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:46.467251 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a5f87fa2-e734-49f3-a3e8-3642c095585d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:46.468371 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a5f87fa2-e734-49f3-a3e8-3642c095585d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:46.477449 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5f87fa2-e734-49f3-a3e8-3642c095585d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:46.477961 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5f87fa2-e734-49f3-a3e8-3642c095585d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:46.478865 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5f87fa2-e734-49f3-a3e8-3642c095585d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:46.479343 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5f87fa2-e734-49f3-a3e8-3642c095585d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:50.471825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-afd1f6b4-bc49-464e-aed8-a47a7e149a15 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 4.107213 Feb 17 03:30:50.472532 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 237/481] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:46 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 4109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:50.486575 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a5f87fa2-e734-49f3-a3e8-3642c095585d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 4.023724 Feb 17 03:30:50.487275 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 245/482] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:46 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 4026 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:30:51.485238 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a4eb7de9-9e84-4c84-93b9-08b7f5a0eb95 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:51.486401 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a4eb7de9-9e84-4c84-93b9-08b7f5a0eb95 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:51.494896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4eb7de9-9e84-4c84-93b9-08b7f5a0eb95 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:51.495403 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4eb7de9-9e84-4c84-93b9-08b7f5a0eb95 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:51.496264 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4eb7de9-9e84-4c84-93b9-08b7f5a0eb95 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:51.496953 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4eb7de9-9e84-4c84-93b9-08b7f5a0eb95 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:51.499314 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-68933473-e0d7-4ee9-9c6b-bbbeba6799ca tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:51.500758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-68933473-e0d7-4ee9-9c6b-bbbeba6799ca tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:51.509345 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-68933473-e0d7-4ee9-9c6b-bbbeba6799ca tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:51.509759 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-68933473-e0d7-4ee9-9c6b-bbbeba6799ca tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:51.510897 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-68933473-e0d7-4ee9-9c6b-bbbeba6799ca tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:51.511613 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-68933473-e0d7-4ee9-9c6b-bbbeba6799ca tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:51.641725 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a4eb7de9-9e84-4c84-93b9-08b7f5a0eb95 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.160863 Feb 17 03:30:51.642467 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 238/483] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:51 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:51.656674 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-68933473-e0d7-4ee9-9c6b-bbbeba6799ca tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.161513 Feb 17 03:30:51.657421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 246/484] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:51 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:30:52.654616 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f8e38913-4e6d-423a-a1ce-6958bf2b1e71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:52.655752 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f8e38913-4e6d-423a-a1ce-6958bf2b1e71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:52.664709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8e38913-4e6d-423a-a1ce-6958bf2b1e71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:52.665272 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8e38913-4e6d-423a-a1ce-6958bf2b1e71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:52.666089 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8e38913-4e6d-423a-a1ce-6958bf2b1e71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:52.666580 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8e38913-4e6d-423a-a1ce-6958bf2b1e71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:52.669123 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-90a5c955-5770-4277-8241-73b1abde1dbb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:52.670260 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-90a5c955-5770-4277-8241-73b1abde1dbb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:52.678716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90a5c955-5770-4277-8241-73b1abde1dbb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:52.679218 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90a5c955-5770-4277-8241-73b1abde1dbb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:52.680663 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90a5c955-5770-4277-8241-73b1abde1dbb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:52.681199 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90a5c955-5770-4277-8241-73b1abde1dbb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:56.169770 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f8e38913-4e6d-423a-a1ce-6958bf2b1e71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 3.519332 Feb 17 03:30:56.170723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 239/485] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:52 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 3521 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:56.200329 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-90a5c955-5770-4277-8241-73b1abde1dbb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 3.535865 Feb 17 03:30:56.201018 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 247/486] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:52 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 3538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:30:57.183786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c92e2e79-6352-4aeb-abe4-cecd74c1269b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:57.184849 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c92e2e79-6352-4aeb-abe4-cecd74c1269b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:57.194209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c92e2e79-6352-4aeb-abe4-cecd74c1269b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:57.194960 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c92e2e79-6352-4aeb-abe4-cecd74c1269b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:57.195798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c92e2e79-6352-4aeb-abe4-cecd74c1269b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:57.196281 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c92e2e79-6352-4aeb-abe4-cecd74c1269b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:57.214580 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b1b84b49-0f00-48ad-b5cd-7cec85d17f40 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:57.215905 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b1b84b49-0f00-48ad-b5cd-7cec85d17f40 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:57.224607 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b1b84b49-0f00-48ad-b5cd-7cec85d17f40 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:57.225228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b1b84b49-0f00-48ad-b5cd-7cec85d17f40 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:57.226159 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b1b84b49-0f00-48ad-b5cd-7cec85d17f40 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:57.227422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b1b84b49-0f00-48ad-b5cd-7cec85d17f40 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:57.333788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c92e2e79-6352-4aeb-abe4-cecd74c1269b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.155161 Feb 17 03:30:57.334500 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 240/487] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:57 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:30:57.361039 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b1b84b49-0f00-48ad-b5cd-7cec85d17f40 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.151231 Feb 17 03:30:57.361859 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 248/488] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:57 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:30:58.349934 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3c9c4fd0-849c-4df8-8020-cd61d2c8da76 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:58.351097 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3c9c4fd0-849c-4df8-8020-cd61d2c8da76 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:58.360187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3c9c4fd0-849c-4df8-8020-cd61d2c8da76 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:58.360691 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3c9c4fd0-849c-4df8-8020-cd61d2c8da76 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:58.361610 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3c9c4fd0-849c-4df8-8020-cd61d2c8da76 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:58.362109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3c9c4fd0-849c-4df8-8020-cd61d2c8da76 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:58.376731 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a4fb9ff6-dd17-40e4-b808-99b8d8bff6e2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:58.377986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a4fb9ff6-dd17-40e4-b808-99b8d8bff6e2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:58.387153 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4fb9ff6-dd17-40e4-b808-99b8d8bff6e2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:58.387666 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4fb9ff6-dd17-40e4-b808-99b8d8bff6e2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:58.388513 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4fb9ff6-dd17-40e4-b808-99b8d8bff6e2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:58.389006 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4fb9ff6-dd17-40e4-b808-99b8d8bff6e2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:58.515826 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3c9c4fd0-849c-4df8-8020-cd61d2c8da76 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.170968 Feb 17 03:30:58.516522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 241/489] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:58 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:30:58.541837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a4fb9ff6-dd17-40e4-b808-99b8d8bff6e2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.171742 Feb 17 03:30:58.542578 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 249/490] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:58 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:30:59.529960 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-12242991-d3ac-4b61-89db-3ca3dd312575 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:59.531201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-12242991-d3ac-4b61-89db-3ca3dd312575 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:59.539872 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-12242991-d3ac-4b61-89db-3ca3dd312575 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:59.540479 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-12242991-d3ac-4b61-89db-3ca3dd312575 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:59.541417 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-12242991-d3ac-4b61-89db-3ca3dd312575 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:59.541979 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-12242991-d3ac-4b61-89db-3ca3dd312575 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:59.555598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2186eb19-c3ed-4038-9421-a944fa8dc640 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:30:59.556851 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2186eb19-c3ed-4038-9421-a944fa8dc640 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:30:59.565654 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2186eb19-c3ed-4038-9421-a944fa8dc640 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:59.566264 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2186eb19-c3ed-4038-9421-a944fa8dc640 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:30:59.567203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2186eb19-c3ed-4038-9421-a944fa8dc640 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:30:59.567998 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2186eb19-c3ed-4038-9421-a944fa8dc640 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:02.386562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-12242991-d3ac-4b61-89db-3ca3dd312575 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 2.862172 Feb 17 03:31:02.387271 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 242/491] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:30:59 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 2864 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:02.411229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2186eb19-c3ed-4038-9421-a944fa8dc640 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 2.860541 Feb 17 03:31:02.411933 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 250/492] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:30:59 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 2863 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:31:03.399361 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-64435df0-9abc-40d6-ba1e-feeb1e518a9b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:03.400628 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-64435df0-9abc-40d6-ba1e-feeb1e518a9b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:03.408846 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-64435df0-9abc-40d6-ba1e-feeb1e518a9b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:03.409399 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-64435df0-9abc-40d6-ba1e-feeb1e518a9b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:03.410233 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-64435df0-9abc-40d6-ba1e-feeb1e518a9b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:03.410720 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-64435df0-9abc-40d6-ba1e-feeb1e518a9b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:03.424713 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-eeb70ddc-4ab7-4924-a64a-e08f9da3a0d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:03.425932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-eeb70ddc-4ab7-4924-a64a-e08f9da3a0d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:03.437493 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eeb70ddc-4ab7-4924-a64a-e08f9da3a0d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:03.437493 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eeb70ddc-4ab7-4924-a64a-e08f9da3a0d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:03.437493 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eeb70ddc-4ab7-4924-a64a-e08f9da3a0d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:03.437493 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eeb70ddc-4ab7-4924-a64a-e08f9da3a0d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:03.602296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-64435df0-9abc-40d6-ba1e-feeb1e518a9b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.206631 Feb 17 03:31:03.602988 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 243/493] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:03 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:03.619402 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-eeb70ddc-4ab7-4924-a64a-e08f9da3a0d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.199105 Feb 17 03:31:03.620092 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 251/494] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:03 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:31:04.615309 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6724f719-3ed2-456b-b010-e6cb4b34e247 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:04.616486 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6724f719-3ed2-456b-b010-e6cb4b34e247 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:04.625663 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6724f719-3ed2-456b-b010-e6cb4b34e247 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:04.629076 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6724f719-3ed2-456b-b010-e6cb4b34e247 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:04.629076 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6724f719-3ed2-456b-b010-e6cb4b34e247 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:04.629076 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6724f719-3ed2-456b-b010-e6cb4b34e247 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:04.637677 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-53f8d3e6-f8ac-441c-8235-832b397f2b6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:04.639057 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-53f8d3e6-f8ac-441c-8235-832b397f2b6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:04.649197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-53f8d3e6-f8ac-441c-8235-832b397f2b6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:04.649852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-53f8d3e6-f8ac-441c-8235-832b397f2b6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:04.650707 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-53f8d3e6-f8ac-441c-8235-832b397f2b6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:04.651202 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-53f8d3e6-f8ac-441c-8235-832b397f2b6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:04.824878 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6724f719-3ed2-456b-b010-e6cb4b34e247 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.213564 Feb 17 03:31:04.825618 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 244/495] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:04 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:04.926612 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-53f8d3e6-f8ac-441c-8235-832b397f2b6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.294921 Feb 17 03:31:04.927429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 252/496] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:04 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:05.838155 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-91b5dba3-6cb6-4377-bb10-1c7e54a763ca tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:05.839307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-91b5dba3-6cb6-4377-bb10-1c7e54a763ca tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:05.848065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-91b5dba3-6cb6-4377-bb10-1c7e54a763ca tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:05.848619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-91b5dba3-6cb6-4377-bb10-1c7e54a763ca tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:05.850054 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-91b5dba3-6cb6-4377-bb10-1c7e54a763ca tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:05.850769 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-91b5dba3-6cb6-4377-bb10-1c7e54a763ca tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:05.940190 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-732509a1-faa7-4bf9-ba5f-b12e8dad1e70 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:05.941368 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-732509a1-faa7-4bf9-ba5f-b12e8dad1e70 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:05.950796 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-732509a1-faa7-4bf9-ba5f-b12e8dad1e70 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:05.951311 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-732509a1-faa7-4bf9-ba5f-b12e8dad1e70 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:05.952154 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-732509a1-faa7-4bf9-ba5f-b12e8dad1e70 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:05.952652 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-732509a1-faa7-4bf9-ba5f-b12e8dad1e70 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:09.362361 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-91b5dba3-6cb6-4377-bb10-1c7e54a763ca tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 3.529093 Feb 17 03:31:09.365455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 245/497] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:05 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 3531 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:09.414129 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-732509a1-faa7-4bf9-ba5f-b12e8dad1e70 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 3.478197 Feb 17 03:31:09.414861 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 253/498] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:05 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 3480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:09.585974 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:31:09.586701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:31:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:31:10.375863 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bd3f97bc-9feb-477f-af3f-677e20744569 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:10.377155 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bd3f97bc-9feb-477f-af3f-677e20744569 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:10.386095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bd3f97bc-9feb-477f-af3f-677e20744569 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:10.386677 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bd3f97bc-9feb-477f-af3f-677e20744569 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:10.387512 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bd3f97bc-9feb-477f-af3f-677e20744569 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:10.388079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bd3f97bc-9feb-477f-af3f-677e20744569 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:10.427068 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-915a1859-982a-4309-87f3-bf017f8aebc8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:10.428246 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-915a1859-982a-4309-87f3-bf017f8aebc8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:10.440707 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-915a1859-982a-4309-87f3-bf017f8aebc8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:10.441249 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-915a1859-982a-4309-87f3-bf017f8aebc8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:10.442094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-915a1859-982a-4309-87f3-bf017f8aebc8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:10.442586 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-915a1859-982a-4309-87f3-bf017f8aebc8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:10.634654 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-915a1859-982a-4309-87f3-bf017f8aebc8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.211993 Feb 17 03:31:10.635346 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 254/499] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:10 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:10.659013 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bd3f97bc-9feb-477f-af3f-677e20744569 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.287486 Feb 17 03:31:10.661019 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 246/500] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:10 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:11.646955 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9239ba26-e3b8-4b79-b32a-aa55a6c14cb1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:11.648146 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9239ba26-e3b8-4b79-b32a-aa55a6c14cb1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:11.657276 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9239ba26-e3b8-4b79-b32a-aa55a6c14cb1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:11.657788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9239ba26-e3b8-4b79-b32a-aa55a6c14cb1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:11.658624 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9239ba26-e3b8-4b79-b32a-aa55a6c14cb1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:11.659115 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9239ba26-e3b8-4b79-b32a-aa55a6c14cb1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:11.672703 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7611e853-1721-4e26-893d-7db83a0e20b8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:11.673974 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7611e853-1721-4e26-893d-7db83a0e20b8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:11.682475 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7611e853-1721-4e26-893d-7db83a0e20b8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:11.682982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7611e853-1721-4e26-893d-7db83a0e20b8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:11.683853 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7611e853-1721-4e26-893d-7db83a0e20b8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:11.684339 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7611e853-1721-4e26-893d-7db83a0e20b8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:11.826582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9239ba26-e3b8-4b79-b32a-aa55a6c14cb1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.183851 Feb 17 03:31:11.827594 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 255/501] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:11 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:11.833128 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a8c4e265-d640-452c-8f51-3d67eb690493 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "322c87fe-f1c4-41c1-9d07-7e35d9cf8359"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:11.834394 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a8c4e265-d640-452c-8f51-3d67eb690493 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:11.841498 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7611e853-1721-4e26-893d-7db83a0e20b8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.173004 Feb 17 03:31:11.842214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 247/502] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:11 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:11.846079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a8c4e265-d640-452c-8f51-3d67eb690493 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:11.846782 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a8c4e265-d640-452c-8f51-3d67eb690493 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:11.847630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a8c4e265-d640-452c-8f51-3d67eb690493 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:11.848121 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a8c4e265-d640-452c-8f51-3d67eb690493 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:12.041907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-a8c4e265-d640-452c-8f51-3d67eb690493 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] HTTP exception thrown: Invalid volume: volume 322c87fe-f1c4-41c1-9d07-7e35d9cf8359 is already attached to instances: 9c691a18-0bdc-4921-9246-3de1981b4c2b Feb 17 03:31:12.042586 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a8c4e265-d640-452c-8f51-3d67eb690493 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Returning 400 to user: Invalid volume: volume 322c87fe-f1c4-41c1-9d07-7e35d9cf8359 is already attached to instances: 9c691a18-0bdc-4921-9246-3de1981b4c2b {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:31:12.043485 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a8c4e265-d640-452c-8f51-3d67eb690493 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "POST /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.214853 Feb 17 03:31:12.044090 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 256/503] 10.222.0.57 () {60 vars in 1313 bytes} [Wed Feb 17 03:31:11 2021] POST /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b/os-volume_attachments => generated 174 bytes in 216 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 03:31:12.171653 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0fd14275-e388-47e8-9d74-d1509159736c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:12.172295 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0fd14275-e388-47e8-9d74-d1509159736c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:12.181351 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0fd14275-e388-47e8-9d74-d1509159736c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:12.181851 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0fd14275-e388-47e8-9d74-d1509159736c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:12.182682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0fd14275-e388-47e8-9d74-d1509159736c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:12.183169 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0fd14275-e388-47e8-9d74-d1509159736c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:12.369978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-0fd14275-e388-47e8-9d74-d1509159736c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lazy-loading 'services' on Instance uuid 9c691a18-0bdc-4921-9246-3de1981b4c2b {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:31:12.577674 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0fd14275-e388-47e8-9d74-d1509159736c tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b/os-volume_attachments/322c87fe-f1c4-41c1-9d07-7e35d9cf8359" status: 202 len: 0 microversion: 2.1 time: 0.409830 Feb 17 03:31:12.578532 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 248/504] 10.222.0.57 () {58 vars in 1406 bytes} [Wed Feb 17 03:31:12 2021] DELETE /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b/os-volume_attachments/322c87fe-f1c4-41c1-9d07-7e35d9cf8359 => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:12.839503 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a95a90dd-d1a9-4608-85ec-a1c0a1eb22aa tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:12.840546 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a95a90dd-d1a9-4608-85ec-a1c0a1eb22aa tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:12.863862 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-34dd02cb-9384-4620-a62b-1d2fade96d75 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:12.864998 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-34dd02cb-9384-4620-a62b-1d2fade96d75 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:12.880636 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a95a90dd-d1a9-4608-85ec-a1c0a1eb22aa tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:12.881201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a95a90dd-d1a9-4608-85ec-a1c0a1eb22aa tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:12.882080 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a95a90dd-d1a9-4608-85ec-a1c0a1eb22aa tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:12.882739 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a95a90dd-d1a9-4608-85ec-a1c0a1eb22aa tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:12.886261 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34dd02cb-9384-4620-a62b-1d2fade96d75 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:12.887668 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34dd02cb-9384-4620-a62b-1d2fade96d75 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:12.889258 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34dd02cb-9384-4620-a62b-1d2fade96d75 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:12.889948 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34dd02cb-9384-4620-a62b-1d2fade96d75 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:13.066530 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a95a90dd-d1a9-4608-85ec-a1c0a1eb22aa tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.231584 Feb 17 03:31:13.067659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 257/505] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:12 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:13.082952 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-34dd02cb-9384-4620-a62b-1d2fade96d75 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.224108 Feb 17 03:31:13.087761 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 249/506] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:12 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:14.080399 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bdf38b46-353c-44e0-a7cb-5c10a686077e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:14.081613 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bdf38b46-353c-44e0-a7cb-5c10a686077e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:14.090623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bdf38b46-353c-44e0-a7cb-5c10a686077e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:14.091969 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bdf38b46-353c-44e0-a7cb-5c10a686077e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:14.093665 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bdf38b46-353c-44e0-a7cb-5c10a686077e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:14.094171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bdf38b46-353c-44e0-a7cb-5c10a686077e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:14.097674 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5f94efa7-9330-4039-9582-7feff0460705 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:14.098807 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5f94efa7-9330-4039-9582-7feff0460705 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:14.107999 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f94efa7-9330-4039-9582-7feff0460705 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:14.108505 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f94efa7-9330-4039-9582-7feff0460705 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:14.109358 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f94efa7-9330-4039-9582-7feff0460705 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:14.110168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f94efa7-9330-4039-9582-7feff0460705 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:14.243378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bdf38b46-353c-44e0-a7cb-5c10a686077e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.167334 Feb 17 03:31:14.244061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 258/507] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:14 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:14.268572 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5f94efa7-9330-4039-9582-7feff0460705 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.175941 Feb 17 03:31:14.269299 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 250/508] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:14 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:31:14.292799 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e6edd2ec-41e5-4875-b161-d43f911e3b0f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:14.293494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e6edd2ec-41e5-4875-b161-d43f911e3b0f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:14.302123 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e6edd2ec-41e5-4875-b161-d43f911e3b0f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:14.302623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e6edd2ec-41e5-4875-b161-d43f911e3b0f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:14.303733 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e6edd2ec-41e5-4875-b161-d43f911e3b0f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:14.304234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e6edd2ec-41e5-4875-b161-d43f911e3b0f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:14.480523 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:31:14.480690 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:31:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:31:14.510220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-e6edd2ec-41e5-4875-b161-d43f911e3b0f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lazy-loading 'services' on Instance uuid affa2e6b-a2e1-47dc-9593-14492775c963 {{(pid=98104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:31:14.676280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e6edd2ec-41e5-4875-b161-d43f911e3b0f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "DELETE /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963/os-volume_attachments/a312cc28-957b-497c-8e7e-8974480e2b16" status: 202 len: 0 microversion: 2.1 time: 0.388713 Feb 17 03:31:14.676949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 259/509] 10.222.0.57 () {58 vars in 1406 bytes} [Wed Feb 17 03:31:14 2021] DELETE /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963/os-volume_attachments/a312cc28-957b-497c-8e7e-8974480e2b16 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:15.256745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cb2e1775-dd26-4b9b-8d40-1ffa3e9301f0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:15.258443 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cb2e1775-dd26-4b9b-8d40-1ffa3e9301f0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:15.267434 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cb2e1775-dd26-4b9b-8d40-1ffa3e9301f0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:15.267938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cb2e1775-dd26-4b9b-8d40-1ffa3e9301f0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:15.268778 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cb2e1775-dd26-4b9b-8d40-1ffa3e9301f0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:15.269293 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cb2e1775-dd26-4b9b-8d40-1ffa3e9301f0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:15.281869 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d9b39aab-26fc-4099-bec3-478183171534 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:15.283382 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d9b39aab-26fc-4099-bec3-478183171534 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:15.292072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d9b39aab-26fc-4099-bec3-478183171534 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:15.293062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d9b39aab-26fc-4099-bec3-478183171534 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:15.294149 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d9b39aab-26fc-4099-bec3-478183171534 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:15.294715 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d9b39aab-26fc-4099-bec3-478183171534 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:15.427216 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cb2e1775-dd26-4b9b-8d40-1ffa3e9301f0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.174827 Feb 17 03:31:15.427907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 251/510] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:15 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:15.451539 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d9b39aab-26fc-4099-bec3-478183171534 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.174171 Feb 17 03:31:15.452336 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 260/511] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:15 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:16.440883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-663157f0-3690-413b-ba13-654f251ef75f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:16.442741 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-663157f0-3690-413b-ba13-654f251ef75f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:16.452092 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-663157f0-3690-413b-ba13-654f251ef75f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:16.452606 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-663157f0-3690-413b-ba13-654f251ef75f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:16.453513 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-663157f0-3690-413b-ba13-654f251ef75f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:16.454017 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-663157f0-3690-413b-ba13-654f251ef75f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:16.464508 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6f1eb3fa-43f5-40b2-bb18-dcfd0fdedcd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:16.466005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6f1eb3fa-43f5-40b2-bb18-dcfd0fdedcd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:16.474765 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6f1eb3fa-43f5-40b2-bb18-dcfd0fdedcd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:16.475590 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6f1eb3fa-43f5-40b2-bb18-dcfd0fdedcd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:16.476694 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6f1eb3fa-43f5-40b2-bb18-dcfd0fdedcd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:16.477397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6f1eb3fa-43f5-40b2-bb18-dcfd0fdedcd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:16.617658 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-663157f0-3690-413b-ba13-654f251ef75f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.180843 Feb 17 03:31:16.618372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 252/512] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:16 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:16.643809 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6f1eb3fa-43f5-40b2-bb18-dcfd0fdedcd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.183485 Feb 17 03:31:16.644642 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 261/513] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:16 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:17.630763 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-09db34ce-e585-47ba-b5cd-44c4eaab009b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:17.632121 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-09db34ce-e585-47ba-b5cd-44c4eaab009b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:17.641164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09db34ce-e585-47ba-b5cd-44c4eaab009b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:17.641686 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09db34ce-e585-47ba-b5cd-44c4eaab009b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:17.642545 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09db34ce-e585-47ba-b5cd-44c4eaab009b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:17.643043 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09db34ce-e585-47ba-b5cd-44c4eaab009b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:17.657186 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8336a019-4169-46a7-9105-99468f664406 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:17.658308 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8336a019-4169-46a7-9105-99468f664406 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:17.667562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8336a019-4169-46a7-9105-99468f664406 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:17.668067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8336a019-4169-46a7-9105-99468f664406 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:17.668899 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8336a019-4169-46a7-9105-99468f664406 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:17.669413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8336a019-4169-46a7-9105-99468f664406 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:17.821839 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-09db34ce-e585-47ba-b5cd-44c4eaab009b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.195308 Feb 17 03:31:17.822784 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 253/514] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:17 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:17.841386 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8336a019-4169-46a7-9105-99468f664406 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.188689 Feb 17 03:31:17.843111 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 262/515] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:17 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:18.835664 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5a1ed4cb-48b4-49a3-8d83-be3701516331 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:18.837197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5a1ed4cb-48b4-49a3-8d83-be3701516331 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:18.865189 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b332eedb-7c2d-4b1b-b26b-77310cda114a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:18.866586 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b332eedb-7c2d-4b1b-b26b-77310cda114a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:18.869467 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a1ed4cb-48b4-49a3-8d83-be3701516331 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:18.870129 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a1ed4cb-48b4-49a3-8d83-be3701516331 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:18.871073 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a1ed4cb-48b4-49a3-8d83-be3701516331 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:18.871560 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a1ed4cb-48b4-49a3-8d83-be3701516331 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:18.892129 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b332eedb-7c2d-4b1b-b26b-77310cda114a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:18.894836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b332eedb-7c2d-4b1b-b26b-77310cda114a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:18.896444 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b332eedb-7c2d-4b1b-b26b-77310cda114a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:18.900516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b332eedb-7c2d-4b1b-b26b-77310cda114a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:19.111202 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5a1ed4cb-48b4-49a3-8d83-be3701516331 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.269839 Feb 17 03:31:19.115634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 254/516] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:18 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:19.145220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b332eedb-7c2d-4b1b-b26b-77310cda114a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.294560 Feb 17 03:31:19.146343 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 263/517] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:18 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:20.126127 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e3ea9809-2ca9-485c-ad4b-ade11bc7e920 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:20.127377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e3ea9809-2ca9-485c-ad4b-ade11bc7e920 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:20.139442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e3ea9809-2ca9-485c-ad4b-ade11bc7e920 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:20.140337 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e3ea9809-2ca9-485c-ad4b-ade11bc7e920 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:20.141525 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e3ea9809-2ca9-485c-ad4b-ade11bc7e920 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:20.142219 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e3ea9809-2ca9-485c-ad4b-ade11bc7e920 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:20.158888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2cc9cc9d-2d45-41f4-8e63-042a32956b0c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:20.160040 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2cc9cc9d-2d45-41f4-8e63-042a32956b0c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:20.182889 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2cc9cc9d-2d45-41f4-8e63-042a32956b0c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:20.183667 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2cc9cc9d-2d45-41f4-8e63-042a32956b0c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:20.185209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2cc9cc9d-2d45-41f4-8e63-042a32956b0c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:20.185865 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2cc9cc9d-2d45-41f4-8e63-042a32956b0c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:20.346063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e3ea9809-2ca9-485c-ad4b-ade11bc7e920 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.225024 Feb 17 03:31:20.347360 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 255/518] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:20 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:20.394778 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2cc9cc9d-2d45-41f4-8e63-042a32956b0c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.240281 Feb 17 03:31:20.395469 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 264/519] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:20 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:31:20.600171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3dde06da-6a3b-457a-babb-bbd4ba1ab426 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:20.602068 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3dde06da-6a3b-457a-babb-bbd4ba1ab426 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:20.613518 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3dde06da-6a3b-457a-babb-bbd4ba1ab426 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:20.614244 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3dde06da-6a3b-457a-babb-bbd4ba1ab426 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:20.615284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3dde06da-6a3b-457a-babb-bbd4ba1ab426 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:20.615749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3dde06da-6a3b-457a-babb-bbd4ba1ab426 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:20.696589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-3dde06da-6a3b-457a-babb-bbd4ba1ab426 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lazy-loading 'flavor' on Instance uuid b4d58358-22a0-4562-9370-9574a29ec572 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:31:21.005397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3dde06da-6a3b-457a-babb-bbd4ba1ab426 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "POST /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572/action" status: 200 len: 32 microversion: 2.1 time: 0.409675 Feb 17 03:31:21.006256 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 256/520] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:20 2021] POST /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572/action => generated 32 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:31:21.039704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2bcd0cd9-68c7-4dff-aeef-4458a81260cd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:21.049987 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2bcd0cd9-68c7-4dff-aeef-4458a81260cd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:21.068001 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2bcd0cd9-68c7-4dff-aeef-4458a81260cd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:21.068709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2bcd0cd9-68c7-4dff-aeef-4458a81260cd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:21.069761 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2bcd0cd9-68c7-4dff-aeef-4458a81260cd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:21.071219 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2bcd0cd9-68c7-4dff-aeef-4458a81260cd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:21.366276 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-863964c3-830e-4315-ab35-81819681b9eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:21.369167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-863964c3-830e-4315-ab35-81819681b9eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:21.380583 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-863964c3-830e-4315-ab35-81819681b9eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:21.381435 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-863964c3-830e-4315-ab35-81819681b9eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:21.383286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-863964c3-830e-4315-ab35-81819681b9eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:21.384374 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-863964c3-830e-4315-ab35-81819681b9eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:21.503727 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2bcd0cd9-68c7-4dff-aeef-4458a81260cd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:21.516165 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2bcd0cd9-68c7-4dff-aeef-4458a81260cd tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1566 microversion: 2.1 time: 0.497844 Feb 17 03:31:21.521568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 265/521] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:21 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1566 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:21.529058 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8eb76cf1-354e-4b2a-9fb3-a63b2badc923 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:21.530202 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8eb76cf1-354e-4b2a-9fb3-a63b2badc923 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:21.553413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8eb76cf1-354e-4b2a-9fb3-a63b2badc923 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:21.553933 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8eb76cf1-354e-4b2a-9fb3-a63b2badc923 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:21.555381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8eb76cf1-354e-4b2a-9fb3-a63b2badc923 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:21.555886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8eb76cf1-354e-4b2a-9fb3-a63b2badc923 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:21.559591 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-863964c3-830e-4315-ab35-81819681b9eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.202648 Feb 17 03:31:21.560284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 257/522] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:21 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:21.713139 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8eb76cf1-354e-4b2a-9fb3-a63b2badc923 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.189727 Feb 17 03:31:21.714528 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 266/523] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:21 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:21.966353 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-056060f0-b85b-41df-ae76-07d1faee1cf1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-260498875", "imageRef": "27891a64-31b3-4754-87b4-bf609a12c59a", "flavorRef": "452", "networks": [{"uuid": "90e5bf38-a0dc-48bd-9401-739bcf8a5d8a"}]}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:22.043830 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-056060f0-b85b-41df-ae76-07d1faee1cf1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] validate_networks() for [('90e5bf38-a0dc-48bd-9401-739bcf8a5d8a', None, None, None)] {{(pid=98103) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:31:22.540317 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-21e440c1-7a0d-490f-9eb9-8dff0bf75047 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:22.541124 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-21e440c1-7a0d-490f-9eb9-8dff0bf75047 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:22.550283 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-21e440c1-7a0d-490f-9eb9-8dff0bf75047 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:22.550987 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-21e440c1-7a0d-490f-9eb9-8dff0bf75047 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:22.552020 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-21e440c1-7a0d-490f-9eb9-8dff0bf75047 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:22.552687 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-21e440c1-7a0d-490f-9eb9-8dff0bf75047 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:22.826032 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-21e440c1-7a0d-490f-9eb9-8dff0bf75047 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:22.836281 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-21e440c1-7a0d-490f-9eb9-8dff0bf75047 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1566 microversion: 2.1 time: 0.300379 Feb 17 03:31:22.836866 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 267/524] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:22 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1566 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:22.842107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bc060a67-c39d-4c0a-9ba5-613d9df7109e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:22.843610 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bc060a67-c39d-4c0a-9ba5-613d9df7109e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:22.866722 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bc060a67-c39d-4c0a-9ba5-613d9df7109e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:22.873706 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bc060a67-c39d-4c0a-9ba5-613d9df7109e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:22.880604 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bc060a67-c39d-4c0a-9ba5-613d9df7109e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:22.882287 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bc060a67-c39d-4c0a-9ba5-613d9df7109e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:23.018293 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bc060a67-c39d-4c0a-9ba5-613d9df7109e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.179704 Feb 17 03:31:23.018961 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 268/525] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:22 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:23.025438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-691b48b2-ca38-46b0-b912-0e3eb29753e4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:23.026530 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-691b48b2-ca38-46b0-b912-0e3eb29753e4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:23.035172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-691b48b2-ca38-46b0-b912-0e3eb29753e4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:23.035914 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-691b48b2-ca38-46b0-b912-0e3eb29753e4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:23.036771 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-691b48b2-ca38-46b0-b912-0e3eb29753e4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:23.037301 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-691b48b2-ca38-46b0-b912-0e3eb29753e4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:23.168215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-691b48b2-ca38-46b0-b912-0e3eb29753e4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.147651 Feb 17 03:31:23.172683 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 269/526] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:23 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:23.175105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e28a5799-0f06-4d23-a015-6e0d1d7b582f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:23.175838 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e28a5799-0f06-4d23-a015-6e0d1d7b582f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:23.190089 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e28a5799-0f06-4d23-a015-6e0d1d7b582f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:23.190713 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e28a5799-0f06-4d23-a015-6e0d1d7b582f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:23.191437 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e28a5799-0f06-4d23-a015-6e0d1d7b582f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:23.191933 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e28a5799-0f06-4d23-a015-6e0d1d7b582f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:23.197565 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-056060f0-b85b-41df-ae76-07d1faee1cf1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:31:23.198051 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-056060f0-b85b-41df-ae76-07d1faee1cf1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:31:23.198598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-056060f0-b85b-41df-ae76-07d1faee1cf1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:31:23.199068 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-056060f0-b85b-41df-ae76-07d1faee1cf1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:31:23.199534 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-056060f0-b85b-41df-ae76-07d1faee1cf1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:31:23.209563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-056060f0-b85b-41df-ae76-07d1faee1cf1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:23.210076 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-056060f0-b85b-41df-ae76-07d1faee1cf1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:23.211290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-056060f0-b85b-41df-ae76-07d1faee1cf1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:23.211792 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-056060f0-b85b-41df-ae76-07d1faee1cf1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:23.230908 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-056060f0-b85b-41df-ae76-07d1faee1cf1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Getting quotas for project 41ae341c7001465897265b1c5eda9767. Resources: {'ram', 'cores', 'instances'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:31:23.235974 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-056060f0-b85b-41df-ae76-07d1faee1cf1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Getting quotas for user 4d9f8d95ac0a4a4bb6aad0bbc963d08d and project 41ae341c7001465897265b1c5eda9767. Resources: {'ram', 'cores', 'instances'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:31:23.252440 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-056060f0-b85b-41df-ae76-07d1faee1cf1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Going to run 1 instances... {{(pid=98103) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:31:23.255369 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-056060f0-b85b-41df-ae76-07d1faee1cf1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27891a64-31b3-4754-87b4-bf609a12c59a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:31:23.270297 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e28a5799-0f06-4d23-a015-6e0d1d7b582f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Going to try to terminate instance {{(pid=98104) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:31:23.307931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-056060f0-b85b-41df-ae76-07d1faee1cf1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.347140 Feb 17 03:31:23.308972 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 258/527] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:31:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 1349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 17 03:31:23.319355 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a46af56f-f21e-4e31-b1eb-1a76adf2d590 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:23.320357 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a46af56f-f21e-4e31-b1eb-1a76adf2d590 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:23.401883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a46af56f-f21e-4e31-b1eb-1a76adf2d590 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:23.411604 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a46af56f-f21e-4e31-b1eb-1a76adf2d590 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1217 microversion: 2.1 time: 0.096096 Feb 17 03:31:23.412428 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 259/528] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:23 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:31:23.433969 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e28a5799-0f06-4d23-a015-6e0d1d7b582f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "DELETE /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 204 len: 0 microversion: 2.1 time: 0.263215 Feb 17 03:31:23.436195 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 270/529] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:31:23 2021] DELETE /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:31:23.444775 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ee636cbe-e983-45d8-9c00-a64b865e2edc tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:23.445982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ee636cbe-e983-45d8-9c00-a64b865e2edc tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:23.464692 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee636cbe-e983-45d8-9c00-a64b865e2edc tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:23.465142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee636cbe-e983-45d8-9c00-a64b865e2edc tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:23.465989 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee636cbe-e983-45d8-9c00-a64b865e2edc tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:23.466457 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee636cbe-e983-45d8-9c00-a64b865e2edc tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:23.692483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ee636cbe-e983-45d8-9c00-a64b865e2edc tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:23.702818 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ee636cbe-e983-45d8-9c00-a64b865e2edc tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1512 microversion: 2.1 time: 0.261781 Feb 17 03:31:23.703494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 260/530] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:23 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1512 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:23.862027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6591fc23-6925-4567-8219-624e7c92103b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:23.869389 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6591fc23-6925-4567-8219-624e7c92103b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:23.885525 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6591fc23-6925-4567-8219-624e7c92103b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:23.886323 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6591fc23-6925-4567-8219-624e7c92103b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:23.887168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6591fc23-6925-4567-8219-624e7c92103b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:23.887670 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6591fc23-6925-4567-8219-624e7c92103b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:24.032042 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0961fcf6-dd70-4b8a-bc14-980ff98adb22 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:24.033397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0961fcf6-dd70-4b8a-bc14-980ff98adb22 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:24.042846 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0961fcf6-dd70-4b8a-bc14-980ff98adb22 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:24.043565 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0961fcf6-dd70-4b8a-bc14-980ff98adb22 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:24.044607 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0961fcf6-dd70-4b8a-bc14-980ff98adb22 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:24.045310 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0961fcf6-dd70-4b8a-bc14-980ff98adb22 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:24.123384 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6591fc23-6925-4567-8219-624e7c92103b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:24.139873 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6591fc23-6925-4567-8219-624e7c92103b tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1566 microversion: 2.1 time: 0.288472 Feb 17 03:31:24.140712 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 271/531] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:23 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1566 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:24.180156 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-47032525-d7f2-4306-ba28-158ad203d1e4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:24.181454 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-47032525-d7f2-4306-ba28-158ad203d1e4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:24.189987 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-47032525-d7f2-4306-ba28-158ad203d1e4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:24.190490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-47032525-d7f2-4306-ba28-158ad203d1e4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:24.191334 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-47032525-d7f2-4306-ba28-158ad203d1e4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:24.191829 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-47032525-d7f2-4306-ba28-158ad203d1e4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:24.214583 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0961fcf6-dd70-4b8a-bc14-980ff98adb22 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.186829 Feb 17 03:31:24.216870 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 261/532] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:24 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:31:24.352994 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-47032525-d7f2-4306-ba28-158ad203d1e4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.176562 Feb 17 03:31:24.354657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 272/533] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:24 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:31:24.433888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-dab3ba9d-9985-41aa-b421-309709d51f4a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:24.436082 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-dab3ba9d-9985-41aa-b421-309709d51f4a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:24.446829 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dab3ba9d-9985-41aa-b421-309709d51f4a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:24.447871 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dab3ba9d-9985-41aa-b421-309709d51f4a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:24.449399 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dab3ba9d-9985-41aa-b421-309709d51f4a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:24.450357 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dab3ba9d-9985-41aa-b421-309709d51f4a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:24.722653 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d678e430-00e1-4703-92a9-eb1d016cdb74 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:24.723441 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d678e430-00e1-4703-92a9-eb1d016cdb74 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:24.728185 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dab3ba9d-9985-41aa-b421-309709d51f4a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:24.738940 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-dab3ba9d-9985-41aa-b421-309709d51f4a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1269 microversion: 2.1 time: 0.311279 Feb 17 03:31:24.757950 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 262/534] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:24 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1269 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:24.760548 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d678e430-00e1-4703-92a9-eb1d016cdb74 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:24.760923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d678e430-00e1-4703-92a9-eb1d016cdb74 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:24.762285 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d678e430-00e1-4703-92a9-eb1d016cdb74 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:24.762865 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d678e430-00e1-4703-92a9-eb1d016cdb74 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:25.161417 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b2316d6e-5863-48f7-bacf-44b65c3a0ed3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:25.162914 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b2316d6e-5863-48f7-bacf-44b65c3a0ed3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:25.173508 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b2316d6e-5863-48f7-bacf-44b65c3a0ed3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:25.174277 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b2316d6e-5863-48f7-bacf-44b65c3a0ed3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:25.175371 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b2316d6e-5863-48f7-bacf-44b65c3a0ed3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:25.176043 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b2316d6e-5863-48f7-bacf-44b65c3a0ed3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:25.217803 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d678e430-00e1-4703-92a9-eb1d016cdb74 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:25.230364 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d678e430-00e1-4703-92a9-eb1d016cdb74 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1512 microversion: 2.1 time: 0.512168 Feb 17 03:31:25.242279 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 273/535] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:24 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1512 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:25.247732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-07a9639c-083b-4435-9c2b-258ce6f9a82b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:25.249001 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-07a9639c-083b-4435-9c2b-258ce6f9a82b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:25.265982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07a9639c-083b-4435-9c2b-258ce6f9a82b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:25.266754 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07a9639c-083b-4435-9c2b-258ce6f9a82b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:25.267771 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07a9639c-083b-4435-9c2b-258ce6f9a82b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:25.271825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07a9639c-083b-4435-9c2b-258ce6f9a82b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:25.430209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-07a9639c-083b-4435-9c2b-258ce6f9a82b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.180745 Feb 17 03:31:25.431418 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 274/536] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:25 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:25.443914 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a8ecae83-0b86-4c2f-b4cf-4a9b01057b0d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:25.446067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a8ecae83-0b86-4c2f-b4cf-4a9b01057b0d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:25.458729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a8ecae83-0b86-4c2f-b4cf-4a9b01057b0d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:25.459412 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a8ecae83-0b86-4c2f-b4cf-4a9b01057b0d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:25.460814 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a8ecae83-0b86-4c2f-b4cf-4a9b01057b0d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:25.461513 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a8ecae83-0b86-4c2f-b4cf-4a9b01057b0d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:25.628873 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a8ecae83-0b86-4c2f-b4cf-4a9b01057b0d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.194798 Feb 17 03:31:25.629889 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 275/537] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:25 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:25.650787 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b2316d6e-5863-48f7-bacf-44b65c3a0ed3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:25.673193 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b2316d6e-5863-48f7-bacf-44b65c3a0ed3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1566 microversion: 2.1 time: 0.517354 Feb 17 03:31:25.685517 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 263/538] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:25 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1566 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:25.767313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-922d732f-cd40-4159-b885-3fcdc0aa6ab5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:25.768078 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-922d732f-cd40-4159-b885-3fcdc0aa6ab5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:25.778447 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-922d732f-cd40-4159-b885-3fcdc0aa6ab5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:25.778960 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-922d732f-cd40-4159-b885-3fcdc0aa6ab5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:25.779804 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-922d732f-cd40-4159-b885-3fcdc0aa6ab5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:25.780522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-922d732f-cd40-4159-b885-3fcdc0aa6ab5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:25.944735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-922d732f-cd40-4159-b885-3fcdc0aa6ab5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:25.956572 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-922d732f-cd40-4159-b885-3fcdc0aa6ab5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1275 microversion: 2.1 time: 0.194787 Feb 17 03:31:25.963956 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 276/539] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:25 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1275 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:26.260878 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9b5c1ec6-9f0d-44c0-9854-163de48ef9ac tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:26.261819 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9b5c1ec6-9f0d-44c0-9854-163de48ef9ac tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:26.269894 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9b5c1ec6-9f0d-44c0-9854-163de48ef9ac tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:26.270708 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9b5c1ec6-9f0d-44c0-9854-163de48ef9ac tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:26.271916 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9b5c1ec6-9f0d-44c0-9854-163de48ef9ac tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:26.273102 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9b5c1ec6-9f0d-44c0-9854-163de48ef9ac tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:26.443958 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e72137d1-60d6-425c-a81c-90487184875e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:26.446193 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e72137d1-60d6-425c-a81c-90487184875e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:26.455164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e72137d1-60d6-425c-a81c-90487184875e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:26.455985 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e72137d1-60d6-425c-a81c-90487184875e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:26.457071 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e72137d1-60d6-425c-a81c-90487184875e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:26.457825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e72137d1-60d6-425c-a81c-90487184875e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:26.654997 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e72137d1-60d6-425c-a81c-90487184875e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.214712 Feb 17 03:31:26.662508 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 277/540] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:26 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:26.671323 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4d42fe03-4c17-4695-8eb8-6a3202122c5b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:26.674772 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4d42fe03-4c17-4695-8eb8-6a3202122c5b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:26.686709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4d42fe03-4c17-4695-8eb8-6a3202122c5b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:26.687464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4d42fe03-4c17-4695-8eb8-6a3202122c5b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:26.688883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4d42fe03-4c17-4695-8eb8-6a3202122c5b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:26.689588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4d42fe03-4c17-4695-8eb8-6a3202122c5b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:26.839560 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9b5c1ec6-9f0d-44c0-9854-163de48ef9ac tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:26.861514 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9b5c1ec6-9f0d-44c0-9854-163de48ef9ac tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1512 microversion: 2.1 time: 0.605608 Feb 17 03:31:26.876527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4d42fe03-4c17-4695-8eb8-6a3202122c5b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.211326 Feb 17 03:31:26.877388 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 264/541] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:26 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1512 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:26.877816 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 278/542] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:26 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:26.894931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d6b6f3d4-6be7-4c20-ba27-b28db9312943 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:26.895871 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d6b6f3d4-6be7-4c20-ba27-b28db9312943 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:26.914843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d6b6f3d4-6be7-4c20-ba27-b28db9312943 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:26.915613 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d6b6f3d4-6be7-4c20-ba27-b28db9312943 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:26.918578 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d6b6f3d4-6be7-4c20-ba27-b28db9312943 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:26.921750 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d6b6f3d4-6be7-4c20-ba27-b28db9312943 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:26.975745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-abc40020-ca5b-4623-8645-b6710d9d4dc4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:26.975931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-abc40020-ca5b-4623-8645-b6710d9d4dc4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:26.994181 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-abc40020-ca5b-4623-8645-b6710d9d4dc4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:26.994702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-abc40020-ca5b-4623-8645-b6710d9d4dc4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:26.995976 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-abc40020-ca5b-4623-8645-b6710d9d4dc4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:26.996114 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-abc40020-ca5b-4623-8645-b6710d9d4dc4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:27.371449 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d6b6f3d4-6be7-4c20-ba27-b28db9312943 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:27.389700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d6b6f3d4-6be7-4c20-ba27-b28db9312943 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1566 microversion: 2.1 time: 0.509818 Feb 17 03:31:27.390596 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 265/543] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:26 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1566 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:27.669887 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a88cec23-3179-4a1d-931d-a01499bcb522 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:27.671267 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a88cec23-3179-4a1d-931d-a01499bcb522 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:27.680959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a88cec23-3179-4a1d-931d-a01499bcb522 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:27.681707 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a88cec23-3179-4a1d-931d-a01499bcb522 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:27.682704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a88cec23-3179-4a1d-931d-a01499bcb522 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:27.683334 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a88cec23-3179-4a1d-931d-a01499bcb522 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:27.833901 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a88cec23-3179-4a1d-931d-a01499bcb522 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.169560 Feb 17 03:31:27.839331 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 266/544] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:27 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:27.885408 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e91e864e-c35a-4867-9be4-00315c3e4dc4 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:27.887464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e91e864e-c35a-4867-9be4-00315c3e4dc4 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:27.915587 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e91e864e-c35a-4867-9be4-00315c3e4dc4 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:27.919222 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e91e864e-c35a-4867-9be4-00315c3e4dc4 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:27.921248 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e91e864e-c35a-4867-9be4-00315c3e4dc4 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:27.924321 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e91e864e-c35a-4867-9be4-00315c3e4dc4 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:28.110648 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-abc40020-ca5b-4623-8645-b6710d9d4dc4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:28.124522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-abc40020-ca5b-4623-8645-b6710d9d4dc4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1317 microversion: 2.1 time: 1.153414 Feb 17 03:31:28.125234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 279/545] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:26 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1317 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:28.137780 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-61be833f-b1bb-42a1-9e6a-d9c879f74344 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:28.142853 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-61be833f-b1bb-42a1-9e6a-d9c879f74344 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:28.163381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-61be833f-b1bb-42a1-9e6a-d9c879f74344 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:28.166060 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-61be833f-b1bb-42a1-9e6a-d9c879f74344 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:28.168651 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-61be833f-b1bb-42a1-9e6a-d9c879f74344 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:28.170537 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-61be833f-b1bb-42a1-9e6a-d9c879f74344 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:28.425596 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-61be833f-b1bb-42a1-9e6a-d9c879f74344 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.296388 Feb 17 03:31:28.426959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 280/546] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:28 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:28.434948 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b2132776-56f9-4974-b2d6-eefc3095f8af tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:28.435726 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b2132776-56f9-4974-b2d6-eefc3095f8af tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:28.443980 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b2132776-56f9-4974-b2d6-eefc3095f8af tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:28.444492 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b2132776-56f9-4974-b2d6-eefc3095f8af tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:28.446246 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b2132776-56f9-4974-b2d6-eefc3095f8af tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:28.446736 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b2132776-56f9-4974-b2d6-eefc3095f8af tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:28.538545 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e91e864e-c35a-4867-9be4-00315c3e4dc4 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:28.547592 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e91e864e-c35a-4867-9be4-00315c3e4dc4 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1512 microversion: 2.1 time: 0.666934 Feb 17 03:31:28.548205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 267/547] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:27 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1512 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:28.848666 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f6b7f39c-8651-4057-93dd-98fe96a79fc3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:28.850611 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f6b7f39c-8651-4057-93dd-98fe96a79fc3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:28.866042 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6b7f39c-8651-4057-93dd-98fe96a79fc3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:28.868129 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6b7f39c-8651-4057-93dd-98fe96a79fc3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:28.870415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6b7f39c-8651-4057-93dd-98fe96a79fc3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:28.871856 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6b7f39c-8651-4057-93dd-98fe96a79fc3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:29.067016 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f6b7f39c-8651-4057-93dd-98fe96a79fc3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.222848 Feb 17 03:31:29.068304 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 268/548] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:28 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:31:29.144731 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7f77af6f-8780-4c95-9d92-085dd7b90459 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:29.145581 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7f77af6f-8780-4c95-9d92-085dd7b90459 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:29.169938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f77af6f-8780-4c95-9d92-085dd7b90459 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:29.169938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f77af6f-8780-4c95-9d92-085dd7b90459 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:29.174177 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f77af6f-8780-4c95-9d92-085dd7b90459 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:29.179503 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f77af6f-8780-4c95-9d92-085dd7b90459 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:29.285064 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b2132776-56f9-4974-b2d6-eefc3095f8af tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:29.300241 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b2132776-56f9-4974-b2d6-eefc3095f8af tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1566 microversion: 2.1 time: 0.872652 Feb 17 03:31:29.301370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 281/549] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:28 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1566 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:29.317068 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-90c59fe0-aa9f-4b5b-ba19-72cc9bdc5ea8 req-7af36b61-cc04-49ae-adeb-0599954e3883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "affa2e6b-a2e1-47dc-9593-14492775c963", "name": "network-vif-deleted", "tag": "e0b1164b-a521-406c-ad35-9ec6820de4cc"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:29.322334 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:31:29.322334 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:31:29.337874 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-90c59fe0-aa9f-4b5b-ba19-72cc9bdc5ea8 req-7af36b61-cc04-49ae-adeb-0599954e3883 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:29.338608 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-90c59fe0-aa9f-4b5b-ba19-72cc9bdc5ea8 req-7af36b61-cc04-49ae-adeb-0599954e3883 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:29.377236 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-90c59fe0-aa9f-4b5b-ba19-72cc9bdc5ea8 req-7af36b61-cc04-49ae-adeb-0599954e3883 service nova] Creating event network-vif-deleted:e0b1164b-a521-406c-ad35-9ec6820de4cc for instance affa2e6b-a2e1-47dc-9593-14492775c963 on hv-cinder-75994 Feb 17 03:31:29.389074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-90c59fe0-aa9f-4b5b-ba19-72cc9bdc5ea8 req-7af36b61-cc04-49ae-adeb-0599954e3883 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075942 Feb 17 03:31:29.392659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 282/550] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:31:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:31:29.441072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d1a3f80b-916f-4319-8a99-a5b869f84b25 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:29.442387 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d1a3f80b-916f-4319-8a99-a5b869f84b25 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:29.454462 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d1a3f80b-916f-4319-8a99-a5b869f84b25 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:29.455483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d1a3f80b-916f-4319-8a99-a5b869f84b25 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:29.456587 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d1a3f80b-916f-4319-8a99-a5b869f84b25 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:29.457335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d1a3f80b-916f-4319-8a99-a5b869f84b25 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:29.604531 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d1a3f80b-916f-4319-8a99-a5b869f84b25 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.168861 Feb 17 03:31:29.606388 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 283/551] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:29 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:29.614753 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-aff48a37-49a8-45b6-9133-29ebc3b96656 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:29.616571 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-aff48a37-49a8-45b6-9133-29ebc3b96656 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:29.630185 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aff48a37-49a8-45b6-9133-29ebc3b96656 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:29.630925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aff48a37-49a8-45b6-9133-29ebc3b96656 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:29.631987 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aff48a37-49a8-45b6-9133-29ebc3b96656 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:29.633226 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aff48a37-49a8-45b6-9133-29ebc3b96656 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:29.932516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aff48a37-49a8-45b6-9133-29ebc3b96656 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:29.933076 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aff48a37-49a8-45b6-9133-29ebc3b96656 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:29.933619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-aff48a37-49a8-45b6-9133-29ebc3b96656 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lazy-loading 'fault' on Instance uuid affa2e6b-a2e1-47dc-9593-14492775c963 {{(pid=98104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:31:30.010536 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7f77af6f-8780-4c95-9d92-085dd7b90459 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:30.028041 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7f77af6f-8780-4c95-9d92-085dd7b90459 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1317 microversion: 2.1 time: 0.888006 Feb 17 03:31:30.038516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 269/552] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:29 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1317 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:30.079747 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7028f614-8f2f-4959-99a8-269fc4c99895 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:30.081094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7028f614-8f2f-4959-99a8-269fc4c99895 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:30.098113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7028f614-8f2f-4959-99a8-269fc4c99895 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:30.098631 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7028f614-8f2f-4959-99a8-269fc4c99895 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:30.101445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7028f614-8f2f-4959-99a8-269fc4c99895 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:30.102139 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7028f614-8f2f-4959-99a8-269fc4c99895 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:30.373567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-aff48a37-49a8-45b6-9133-29ebc3b96656 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:30.386264 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-aff48a37-49a8-45b6-9133-29ebc3b96656 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 200 len: 1308 microversion: 2.1 time: 0.776976 Feb 17 03:31:30.387533 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 284/553] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:29 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 1308 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:30.404601 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6838c542-2450-469f-bd39-606ea53847e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:30.405764 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6838c542-2450-469f-bd39-606ea53847e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:30.408409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7028f614-8f2f-4959-99a8-269fc4c99895 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.332199 Feb 17 03:31:30.412561 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 270/554] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:30 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:30.415912 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6838c542-2450-469f-bd39-606ea53847e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:30.416740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6838c542-2450-469f-bd39-606ea53847e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:30.417840 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6838c542-2450-469f-bd39-606ea53847e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:30.418478 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6838c542-2450-469f-bd39-606ea53847e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:30.619857 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cfae7b74-8f5a-41c9-9f8f-ed8c456ac4d4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:30.621243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cfae7b74-8f5a-41c9-9f8f-ed8c456ac4d4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:30.644099 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cfae7b74-8f5a-41c9-9f8f-ed8c456ac4d4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:30.651204 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cfae7b74-8f5a-41c9-9f8f-ed8c456ac4d4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:30.652836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cfae7b74-8f5a-41c9-9f8f-ed8c456ac4d4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:30.653651 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cfae7b74-8f5a-41c9-9f8f-ed8c456ac4d4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:30.842205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cfae7b74-8f5a-41c9-9f8f-ed8c456ac4d4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.228101 Feb 17 03:31:30.843286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 271/555] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:30 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:31:31.047392 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1476cbb7-5932-458f-934f-05f9430a85bb tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:31.048320 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1476cbb7-5932-458f-934f-05f9430a85bb tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:31.073732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1476cbb7-5932-458f-934f-05f9430a85bb tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:31.074414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1476cbb7-5932-458f-934f-05f9430a85bb tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:31.075423 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1476cbb7-5932-458f-934f-05f9430a85bb tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:31.076036 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1476cbb7-5932-458f-934f-05f9430a85bb tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:31.517501 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6838c542-2450-469f-bd39-606ea53847e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:31.530418 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6838c542-2450-469f-bd39-606ea53847e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1566 microversion: 2.1 time: 1.136102 Feb 17 03:31:31.531274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 285/556] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:30 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1566 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:31.536447 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-440aff23-6ba8-473f-9785-da617e53a7c6 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:31.537324 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-440aff23-6ba8-473f-9785-da617e53a7c6 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: affa2e6b-a2e1-47dc-9593-14492775c963] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:31.550977 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-440aff23-6ba8-473f-9785-da617e53a7c6 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:31.552259 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-440aff23-6ba8-473f-9785-da617e53a7c6 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:31.553404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-440aff23-6ba8-473f-9785-da617e53a7c6 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:31.554066 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-440aff23-6ba8-473f-9785-da617e53a7c6 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:31.626175 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-440aff23-6ba8-473f-9785-da617e53a7c6 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] HTTP exception thrown: Instance affa2e6b-a2e1-47dc-9593-14492775c963 could not be found. Feb 17 03:31:31.626854 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-440aff23-6ba8-473f-9785-da617e53a7c6 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Returning 404 to user: Instance affa2e6b-a2e1-47dc-9593-14492775c963 could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:31:31.627769 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-440aff23-6ba8-473f-9785-da617e53a7c6 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963" status: 404 len: 111 microversion: 2.1 time: 0.094983 Feb 17 03:31:31.628574 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 286/557] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:31 2021] GET /compute/v2.1/servers/affa2e6b-a2e1-47dc-9593-14492775c963 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:31:31.640604 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-14406d58-fc34-4c31-816d-40d655757ddf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:31.641693 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-14406d58-fc34-4c31-816d-40d655757ddf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:31.653637 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-14406d58-fc34-4c31-816d-40d655757ddf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:31.654144 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-14406d58-fc34-4c31-816d-40d655757ddf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:31.655003 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-14406d58-fc34-4c31-816d-40d655757ddf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:31.655499 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-14406d58-fc34-4c31-816d-40d655757ddf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:32.146638 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-14406d58-fc34-4c31-816d-40d655757ddf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.511857 Feb 17 03:31:32.147793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 287/558] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:31 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:32.154151 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-0a906280-f3a7-459d-8d57-82dc0a633a2d req-6ad1391c-c864-4c46-9999-4bee578af5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f", "tag": "2695e8c8-f6c0-48e2-9f5f-06e7275761a5"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:32.160092 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:31:32.160092 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:31:32.175564 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-0a906280-f3a7-459d-8d57-82dc0a633a2d req-6ad1391c-c864-4c46-9999-4bee578af5b4 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:32.184424 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-0a906280-f3a7-459d-8d57-82dc0a633a2d req-6ad1391c-c864-4c46-9999-4bee578af5b4 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:32.230177 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-0a906280-f3a7-459d-8d57-82dc0a633a2d req-6ad1391c-c864-4c46-9999-4bee578af5b4 service nova] Creating event network-changed:2695e8c8-f6c0-48e2-9f5f-06e7275761a5 for instance 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f on hv-cinder-75994 Feb 17 03:31:32.236316 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-0a906280-f3a7-459d-8d57-82dc0a633a2d req-6ad1391c-c864-4c46-9999-4bee578af5b4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086879 Feb 17 03:31:32.237059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 288/559] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:31:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:31:32.249642 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f4a45fdb-f93c-49ef-80b1-232de5efb8bc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:32.251059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f4a45fdb-f93c-49ef-80b1-232de5efb8bc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:32.260319 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4a45fdb-f93c-49ef-80b1-232de5efb8bc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:32.260949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4a45fdb-f93c-49ef-80b1-232de5efb8bc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:32.261968 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4a45fdb-f93c-49ef-80b1-232de5efb8bc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:32.262761 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4a45fdb-f93c-49ef-80b1-232de5efb8bc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:32.288005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1476cbb7-5932-458f-934f-05f9430a85bb tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:32.310103 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1476cbb7-5932-458f-934f-05f9430a85bb tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1317 microversion: 2.1 time: 1.267474 Feb 17 03:31:32.312687 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 272/560] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:31 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1317 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:32.455730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f4a45fdb-f93c-49ef-80b1-232de5efb8bc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.215760 Feb 17 03:31:32.459905 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 289/561] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:32 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:32.550108 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e5540341-ad5c-4921-87fd-334e331cd8d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:32.550952 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e5540341-ad5c-4921-87fd-334e331cd8d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:32.566728 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5540341-ad5c-4921-87fd-334e331cd8d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:32.568603 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5540341-ad5c-4921-87fd-334e331cd8d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:32.570280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5540341-ad5c-4921-87fd-334e331cd8d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:32.573104 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5540341-ad5c-4921-87fd-334e331cd8d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:33.071386 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e5540341-ad5c-4921-87fd-334e331cd8d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:33.083065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e5540341-ad5c-4921-87fd-334e331cd8d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1566 microversion: 2.1 time: 0.537946 Feb 17 03:31:33.088842 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 273/562] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:32 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1566 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:33.159583 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-987e8008-830b-4c0c-a819-9bb944ed08ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:33.160737 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-987e8008-830b-4c0c-a819-9bb944ed08ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:33.176203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-987e8008-830b-4c0c-a819-9bb944ed08ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:33.177448 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-987e8008-830b-4c0c-a819-9bb944ed08ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:33.178473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-987e8008-830b-4c0c-a819-9bb944ed08ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:33.179115 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-987e8008-830b-4c0c-a819-9bb944ed08ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:33.332189 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fc3735c3-d012-4140-b079-9e50d5c0a621 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:33.332837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fc3735c3-d012-4140-b079-9e50d5c0a621 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:33.341436 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fc3735c3-d012-4140-b079-9e50d5c0a621 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:33.342165 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fc3735c3-d012-4140-b079-9e50d5c0a621 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:33.343008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fc3735c3-d012-4140-b079-9e50d5c0a621 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:33.343579 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fc3735c3-d012-4140-b079-9e50d5c0a621 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:33.759131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-fc3735c3-d012-4140-b079-9e50d5c0a621 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:33.768773 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fc3735c3-d012-4140-b079-9e50d5c0a621 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1317 microversion: 2.1 time: 0.441692 Feb 17 03:31:33.769422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 274/563] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:33 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:31:33.785745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1af65dbd-a675-4c9e-b2b7-e82b43303a90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:33.786966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1af65dbd-a675-4c9e-b2b7-e82b43303a90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:33.795533 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1af65dbd-a675-4c9e-b2b7-e82b43303a90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:33.796141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1af65dbd-a675-4c9e-b2b7-e82b43303a90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:33.797102 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1af65dbd-a675-4c9e-b2b7-e82b43303a90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:33.797676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1af65dbd-a675-4c9e-b2b7-e82b43303a90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:37.009395 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-987e8008-830b-4c0c-a819-9bb944ed08ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 3.853858 Feb 17 03:31:37.010362 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 290/564] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:33 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 3856 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:37.015825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7608ad0d-cf7f-49d8-9691-ab06717dda9e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:37.016575 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7608ad0d-cf7f-49d8-9691-ab06717dda9e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:37.025701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7608ad0d-cf7f-49d8-9691-ab06717dda9e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:37.026212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7608ad0d-cf7f-49d8-9691-ab06717dda9e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:37.027043 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7608ad0d-cf7f-49d8-9691-ab06717dda9e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:37.027538 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7608ad0d-cf7f-49d8-9691-ab06717dda9e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:37.032167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1af65dbd-a675-4c9e-b2b7-e82b43303a90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 3.261385 Feb 17 03:31:37.033089 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 275/565] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:33 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 3263 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:37.243388 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7608ad0d-cf7f-49d8-9691-ab06717dda9e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:37.252990 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7608ad0d-cf7f-49d8-9691-ab06717dda9e tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1566 microversion: 2.1 time: 0.241457 Feb 17 03:31:37.254390 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 291/566] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:37 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1566 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:37.258885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-97333edf-47e8-4e5c-8567-2b024444d28a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:37.259931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-97333edf-47e8-4e5c-8567-2b024444d28a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:37.268213 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-97333edf-47e8-4e5c-8567-2b024444d28a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:37.268724 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-97333edf-47e8-4e5c-8567-2b024444d28a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:37.269784 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-97333edf-47e8-4e5c-8567-2b024444d28a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:37.270202 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-97333edf-47e8-4e5c-8567-2b024444d28a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:37.283732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ae11cec2-a542-46b7-b41d-4dd980fd0cb1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Action: 'create', calling method: .version_select at 0x7f98b0547b70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-461955903"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:37.311837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-ae11cec2-a542-46b7-b41d-4dd980fd0cb1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Getting quotas for project 09f977ccc1e54aa6bfffd127c9a4be7d. Resources: {'key_pairs'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:31:37.316454 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-ae11cec2-a542-46b7-b41d-4dd980fd0cb1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Getting quotas for user 1c16fada80664e0cb2bc0031171b6c04 and project 09f977ccc1e54aa6bfffd127c9a4be7d. Resources: {'key_pairs'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:31:37.510902 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-ae11cec2-a542-46b7-b41d-4dd980fd0cb1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Getting quotas for project 09f977ccc1e54aa6bfffd127c9a4be7d. Resources: {'key_pairs'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:31:37.515996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-ae11cec2-a542-46b7-b41d-4dd980fd0cb1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Getting quotas for user 1c16fada80664e0cb2bc0031171b6c04 and project 09f977ccc1e54aa6bfffd127c9a4be7d. Resources: {'key_pairs'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:31:37.532058 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ae11cec2-a542-46b7-b41d-4dd980fd0cb1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.497445 Feb 17 03:31:37.532808 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 276/567] 10.222.0.57 () {60 vars in 1148 bytes} [Wed Feb 17 03:31:37 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:37.547030 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cd864bca-8211-475c-91ac-5dcae672cfae tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Action: 'create', calling method: .version_select at 0x7f98b02c8840>, body: {"security_group": {"name": "tempest-TestVolumeBootPattern-107357108", "description": "tempest-TestVolumeBootPattern-107357108 description"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:37.599827 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-97333edf-47e8-4e5c-8567-2b024444d28a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:37.611703 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-97333edf-47e8-4e5c-8567-2b024444d28a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1317 microversion: 2.1 time: 0.356901 Feb 17 03:31:37.612331 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 292/568] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:37 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:37.783453 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cd864bca-8211-475c-91ac-5dcae672cfae tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.243431 Feb 17 03:31:37.785358 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 277/569] 10.222.0.57 () {60 vars in 1170 bytes} [Wed Feb 17 03:31:37 2021] POST /compute/v2.1/os-security-groups => generated 249 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:31:37.797165 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-72ac2906-e0e7-48c7-85a2-5c547dd644ad tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Action: 'create', calling method: .version_select at 0x7f98b01646a8>, body: {"security_group_rule": {"parent_group_id": "42a135cc-1e4e-4724-8c79-cda705e48efc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:38.021783 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-94fb1bee-24ba-48b8-a9ed-d1378ad7dcd3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:38.023028 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-94fb1bee-24ba-48b8-a9ed-d1378ad7dcd3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:38.031372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-94fb1bee-24ba-48b8-a9ed-d1378ad7dcd3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:38.032268 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-94fb1bee-24ba-48b8-a9ed-d1378ad7dcd3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:38.033321 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-94fb1bee-24ba-48b8-a9ed-d1378ad7dcd3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:38.033892 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-94fb1bee-24ba-48b8-a9ed-d1378ad7dcd3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:38.053056 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-72ac2906-e0e7-48c7-85a2-5c547dd644ad tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.252599 Feb 17 03:31:38.053056 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 293/570] 10.222.0.57 () {60 vars in 1185 bytes} [Wed Feb 17 03:31:37 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:31:38.059430 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bccf54d9-6e7b-4080-8275-ed22ba081b17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:38.060993 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bccf54d9-6e7b-4080-8275-ed22ba081b17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:38.070227 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bccf54d9-6e7b-4080-8275-ed22ba081b17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:38.070951 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bccf54d9-6e7b-4080-8275-ed22ba081b17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:38.071810 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bccf54d9-6e7b-4080-8275-ed22ba081b17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:38.072287 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bccf54d9-6e7b-4080-8275-ed22ba081b17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:38.263308 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-94fb1bee-24ba-48b8-a9ed-d1378ad7dcd3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.245674 Feb 17 03:31:38.269005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 278/571] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:38 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:31:38.269606 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-434830d8-b983-41a9-b562-f06272401003 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Action: 'create', calling method: .version_select at 0x7f98b03008c8>, body: {"security_group_rule": {"parent_group_id": "42a135cc-1e4e-4724-8c79-cda705e48efc", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:38.291409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bccf54d9-6e7b-4080-8275-ed22ba081b17 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.236908 Feb 17 03:31:38.295941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 294/572] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:38 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:38.298186 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-571d423f-fe8e-45b4-a7d1-34b5b391329c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:38.298974 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-571d423f-fe8e-45b4-a7d1-34b5b391329c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:38.308477 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-571d423f-fe8e-45b4-a7d1-34b5b391329c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:38.308980 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-571d423f-fe8e-45b4-a7d1-34b5b391329c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:38.309889 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-571d423f-fe8e-45b4-a7d1-34b5b391329c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:38.310384 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-571d423f-fe8e-45b4-a7d1-34b5b391329c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:38.516593 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-434830d8-b983-41a9-b562-f06272401003 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.251248 Feb 17 03:31:38.517850 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 279/573] 10.222.0.57 () {60 vars in 1185 bytes} [Wed Feb 17 03:31:38 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:31:38.536057 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-571d423f-fe8e-45b4-a7d1-34b5b391329c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:38.548230 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-571d423f-fe8e-45b4-a7d1-34b5b391329c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1566 microversion: 2.1 time: 0.254653 Feb 17 03:31:38.548900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 295/574] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:38 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1566 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:38.629910 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5abbe314-fdf1-47f0-b186-6f3cba236e70 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:38.630802 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5abbe314-fdf1-47f0-b186-6f3cba236e70 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:38.643967 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5abbe314-fdf1-47f0-b186-6f3cba236e70 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:38.644485 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5abbe314-fdf1-47f0-b186-6f3cba236e70 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:38.645457 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5abbe314-fdf1-47f0-b186-6f3cba236e70 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:38.645851 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5abbe314-fdf1-47f0-b186-6f3cba236e70 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:38.902257 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5abbe314-fdf1-47f0-b186-6f3cba236e70 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:38.915987 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5abbe314-fdf1-47f0-b186-6f3cba236e70 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1317 microversion: 2.1 time: 0.289830 Feb 17 03:31:38.916808 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 280/575] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:38 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:39.275918 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-06885be2-8a30-40cf-bebd-273987f7e711 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:39.276971 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-06885be2-8a30-40cf-bebd-273987f7e711 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:39.285123 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-06885be2-8a30-40cf-bebd-273987f7e711 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:39.285624 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-06885be2-8a30-40cf-bebd-273987f7e711 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:39.286480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-06885be2-8a30-40cf-bebd-273987f7e711 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:39.286976 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-06885be2-8a30-40cf-bebd-273987f7e711 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:39.304017 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-45148033-f24f-4a4a-b6c5-ebaba6fc032f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:39.306026 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-45148033-f24f-4a4a-b6c5-ebaba6fc032f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:39.314886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45148033-f24f-4a4a-b6c5-ebaba6fc032f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:39.315528 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45148033-f24f-4a4a-b6c5-ebaba6fc032f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:39.316373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45148033-f24f-4a4a-b6c5-ebaba6fc032f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:39.316837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45148033-f24f-4a4a-b6c5-ebaba6fc032f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:39.533268 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-06885be2-8a30-40cf-bebd-273987f7e711 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.261334 Feb 17 03:31:39.533958 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 296/576] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:39 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:39.561318 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-45148033-f24f-4a4a-b6c5-ebaba6fc032f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.260947 Feb 17 03:31:39.562284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 281/577] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:39 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:39.566988 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ef92dd04-d60b-454f-aafa-00abf3f5280c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:39.567704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ef92dd04-d60b-454f-aafa-00abf3f5280c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:39.576782 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef92dd04-d60b-454f-aafa-00abf3f5280c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:39.577318 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef92dd04-d60b-454f-aafa-00abf3f5280c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:39.578161 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef92dd04-d60b-454f-aafa-00abf3f5280c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:39.578654 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef92dd04-d60b-454f-aafa-00abf3f5280c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:39.799538 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ef92dd04-d60b-454f-aafa-00abf3f5280c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:39.808951 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ef92dd04-d60b-454f-aafa-00abf3f5280c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1566 microversion: 2.1 time: 0.246404 Feb 17 03:31:39.809621 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 297/578] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:39 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1566 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:31:39.934679 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-270edd8b-2df1-4066-815f-1336aa037dd4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:39.935438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-270edd8b-2df1-4066-815f-1336aa037dd4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:39.943967 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-270edd8b-2df1-4066-815f-1336aa037dd4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:39.944473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-270edd8b-2df1-4066-815f-1336aa037dd4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:39.945588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-270edd8b-2df1-4066-815f-1336aa037dd4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:39.946077 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-270edd8b-2df1-4066-815f-1336aa037dd4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:40.162851 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-270edd8b-2df1-4066-815f-1336aa037dd4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:40.172291 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-270edd8b-2df1-4066-815f-1336aa037dd4 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1317 microversion: 2.1 time: 0.241962 Feb 17 03:31:40.173062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 282/579] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:39 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:40.545764 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0e8e58c8-f876-446d-86b3-1961f7a2706f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:40.546799 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0e8e58c8-f876-446d-86b3-1961f7a2706f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:40.555016 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0e8e58c8-f876-446d-86b3-1961f7a2706f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:40.555518 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0e8e58c8-f876-446d-86b3-1961f7a2706f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:40.556340 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0e8e58c8-f876-446d-86b3-1961f7a2706f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:40.556828 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0e8e58c8-f876-446d-86b3-1961f7a2706f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:40.574181 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a4c1ae01-ed10-43b7-8474-04c7fdd25a6d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:40.575306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a4c1ae01-ed10-43b7-8474-04c7fdd25a6d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:40.583599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4c1ae01-ed10-43b7-8474-04c7fdd25a6d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:40.584184 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4c1ae01-ed10-43b7-8474-04c7fdd25a6d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:40.585131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4c1ae01-ed10-43b7-8474-04c7fdd25a6d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:40.585740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4c1ae01-ed10-43b7-8474-04c7fdd25a6d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:45.468360 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0e8e58c8-f876-446d-86b3-1961f7a2706f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 4.923733 Feb 17 03:31:45.468360 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 298/580] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:40 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 4926 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:45.473524 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-04ac881a-b2f9-4ffe-a089-d1b0bd30d3e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:45.474396 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-04ac881a-b2f9-4ffe-a089-d1b0bd30d3e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:45.483023 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-04ac881a-b2f9-4ffe-a089-d1b0bd30d3e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:45.483522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-04ac881a-b2f9-4ffe-a089-d1b0bd30d3e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:45.484358 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-04ac881a-b2f9-4ffe-a089-d1b0bd30d3e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:45.484840 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-04ac881a-b2f9-4ffe-a089-d1b0bd30d3e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:45.501351 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a4c1ae01-ed10-43b7-8474-04c7fdd25a6d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 4.931357 Feb 17 03:31:45.505575 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 283/581] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:40 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 4933 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:31:45.508340 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-94546b05-0b55-450c-ac0f-db5b858272f2 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:45.509624 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-94546b05-0b55-450c-ac0f-db5b858272f2 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:45.518845 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-94546b05-0b55-450c-ac0f-db5b858272f2 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:45.519351 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-94546b05-0b55-450c-ac0f-db5b858272f2 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:45.520195 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-94546b05-0b55-450c-ac0f-db5b858272f2 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:45.520680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-94546b05-0b55-450c-ac0f-db5b858272f2 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:45.742634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-94546b05-0b55-450c-ac0f-db5b858272f2 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:45.751673 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-94546b05-0b55-450c-ac0f-db5b858272f2 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1317 microversion: 2.1 time: 0.247604 Feb 17 03:31:45.752275 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 284/582] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:45 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:45.798035 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-04ac881a-b2f9-4ffe-a089-d1b0bd30d3e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:45.807984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-04ac881a-b2f9-4ffe-a089-d1b0bd30d3e6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1566 microversion: 2.1 time: 0.339529 Feb 17 03:31:45.808453 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 299/583] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:45 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1566 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:46.482521 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f6a30408-7634-4814-b001-a2859149e7b5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:46.483564 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f6a30408-7634-4814-b001-a2859149e7b5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:46.491293 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6a30408-7634-4814-b001-a2859149e7b5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:46.491792 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6a30408-7634-4814-b001-a2859149e7b5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:46.492779 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6a30408-7634-4814-b001-a2859149e7b5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:46.493292 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6a30408-7634-4814-b001-a2859149e7b5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:46.514606 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-81fc4446-a3ef-4c92-8251-ec79879c0cf2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:46.516182 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-81fc4446-a3ef-4c92-8251-ec79879c0cf2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:46.527460 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-81fc4446-a3ef-4c92-8251-ec79879c0cf2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:46.527962 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-81fc4446-a3ef-4c92-8251-ec79879c0cf2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:46.528821 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-81fc4446-a3ef-4c92-8251-ec79879c0cf2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:46.529345 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-81fc4446-a3ef-4c92-8251-ec79879c0cf2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:46.668315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f6a30408-7634-4814-b001-a2859149e7b5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.190104 Feb 17 03:31:46.668941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 285/584] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:46 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:46.674418 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0013ce58-3af7-4a6f-89be-c335bbd887cb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-339422161", "imageRef": "27891a64-31b3-4754-87b4-bf609a12c59a", "flavorRef": "452", "networks": [{"uuid": "8d611967-ac3b-4d3e-854e-ff34ac61dc4a"}]}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:46.739408 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-81fc4446-a3ef-4c92-8251-ec79879c0cf2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.229378 Feb 17 03:31:46.744058 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 300/585] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:46 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:46.744213 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-0013ce58-3af7-4a6f-89be-c335bbd887cb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] validate_networks() for [('8d611967-ac3b-4d3e-854e-ff34ac61dc4a', None, None, None)] {{(pid=98103) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:31:46.770118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-54e4d422-3ba4-4d54-b60c-1a538f2902e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:46.771133 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-54e4d422-3ba4-4d54-b60c-1a538f2902e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:46.780222 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54e4d422-3ba4-4d54-b60c-1a538f2902e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:46.780724 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54e4d422-3ba4-4d54-b60c-1a538f2902e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:46.781620 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54e4d422-3ba4-4d54-b60c-1a538f2902e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:46.782111 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54e4d422-3ba4-4d54-b60c-1a538f2902e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:47.026326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-54e4d422-3ba4-4d54-b60c-1a538f2902e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:47.035489 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-54e4d422-3ba4-4d54-b60c-1a538f2902e7 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1317 microversion: 2.1 time: 0.269800 Feb 17 03:31:47.036093 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 301/586] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:46 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:31:47.041276 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5a7b4efc-d2bc-482c-b3f3-1b2919da7b74 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:47.042060 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5a7b4efc-d2bc-482c-b3f3-1b2919da7b74 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:47.049565 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a7b4efc-d2bc-482c-b3f3-1b2919da7b74 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:47.050069 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a7b4efc-d2bc-482c-b3f3-1b2919da7b74 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:47.050905 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a7b4efc-d2bc-482c-b3f3-1b2919da7b74 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:47.051397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a7b4efc-d2bc-482c-b3f3-1b2919da7b74 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:47.279470 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5a7b4efc-d2bc-482c-b3f3-1b2919da7b74 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:47.289926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5a7b4efc-d2bc-482c-b3f3-1b2919da7b74 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1566 microversion: 2.1 time: 0.252681 Feb 17 03:31:47.290657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 302/587] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:47 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1566 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:47.515461 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-0013ce58-3af7-4a6f-89be-c335bbd887cb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:31:47.515924 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-0013ce58-3af7-4a6f-89be-c335bbd887cb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:31:47.516462 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-0013ce58-3af7-4a6f-89be-c335bbd887cb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:31:47.516920 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-0013ce58-3af7-4a6f-89be-c335bbd887cb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:31:47.517409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-0013ce58-3af7-4a6f-89be-c335bbd887cb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:31:47.526440 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0013ce58-3af7-4a6f-89be-c335bbd887cb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:47.526973 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0013ce58-3af7-4a6f-89be-c335bbd887cb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:47.527821 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0013ce58-3af7-4a6f-89be-c335bbd887cb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:47.528314 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0013ce58-3af7-4a6f-89be-c335bbd887cb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:47.547685 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-0013ce58-3af7-4a6f-89be-c335bbd887cb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Getting quotas for project 90b33b201e9c4aaa92ca566c8f7e6dac. Resources: {'ram', 'cores', 'instances'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:31:47.552052 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-0013ce58-3af7-4a6f-89be-c335bbd887cb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Getting quotas for user 03ffe03f3f7040418e36d56834cbb18e and project 90b33b201e9c4aaa92ca566c8f7e6dac. Resources: {'ram', 'cores', 'instances'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:31:47.563984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0013ce58-3af7-4a6f-89be-c335bbd887cb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Going to run 1 instances... {{(pid=98103) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:31:47.566757 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0013ce58-3af7-4a6f-89be-c335bbd887cb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27891a64-31b3-4754-87b4-bf609a12c59a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:31:47.618688 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0013ce58-3af7-4a6f-89be-c335bbd887cb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.948374 Feb 17 03:31:47.620105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 286/588] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:31:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:31:47.630671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-27a13458-5885-46fd-a2a5-1f3e167afb46 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:47.631337 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-27a13458-5885-46fd-a2a5-1f3e167afb46 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:47.680309 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-85838827-a7ea-4a55-a63f-b692cd764146 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:47.682295 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-85838827-a7ea-4a55-a63f-b692cd764146 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:47.691789 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85838827-a7ea-4a55-a63f-b692cd764146 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:47.694180 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85838827-a7ea-4a55-a63f-b692cd764146 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:47.694180 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85838827-a7ea-4a55-a63f-b692cd764146 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:47.694544 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85838827-a7ea-4a55-a63f-b692cd764146 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:47.710069 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-27a13458-5885-46fd-a2a5-1f3e167afb46 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:47.725885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-27a13458-5885-46fd-a2a5-1f3e167afb46 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1218 microversion: 2.1 time: 0.094450 Feb 17 03:31:47.727081 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 303/589] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:47 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:47.752393 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e12ab512-6af8-41f1-9047-ff7b2287a830 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:47.753585 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e12ab512-6af8-41f1-9047-ff7b2287a830 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:47.762417 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e12ab512-6af8-41f1-9047-ff7b2287a830 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:47.762983 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e12ab512-6af8-41f1-9047-ff7b2287a830 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:47.764107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e12ab512-6af8-41f1-9047-ff7b2287a830 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:47.764537 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e12ab512-6af8-41f1-9047-ff7b2287a830 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:47.945602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-85838827-a7ea-4a55-a63f-b692cd764146 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.268866 Feb 17 03:31:47.947063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 287/590] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:47 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:47.990203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e12ab512-6af8-41f1-9047-ff7b2287a830 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.241758 Feb 17 03:31:47.991141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 304/591] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:47 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:31:48.055490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d1a4f847-0588-4c65-b5cd-ec433b274f63 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:48.057390 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d1a4f847-0588-4c65-b5cd-ec433b274f63 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:48.066311 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d1a4f847-0588-4c65-b5cd-ec433b274f63 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:48.066853 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d1a4f847-0588-4c65-b5cd-ec433b274f63 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:48.067842 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d1a4f847-0588-4c65-b5cd-ec433b274f63 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:48.068337 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d1a4f847-0588-4c65-b5cd-ec433b274f63 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:48.286154 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d1a4f847-0588-4c65-b5cd-ec433b274f63 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:48.295930 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d1a4f847-0588-4c65-b5cd-ec433b274f63 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1317 microversion: 2.1 time: 0.245667 Feb 17 03:31:48.296809 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 288/592] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:48 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:48.309287 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1899d865-5f07-4868-9f73-c2b9640f2d4a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:48.310068 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1899d865-5f07-4868-9f73-c2b9640f2d4a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:48.318615 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1899d865-5f07-4868-9f73-c2b9640f2d4a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:48.319129 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1899d865-5f07-4868-9f73-c2b9640f2d4a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:48.320241 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1899d865-5f07-4868-9f73-c2b9640f2d4a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:48.320737 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1899d865-5f07-4868-9f73-c2b9640f2d4a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:48.533885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1899d865-5f07-4868-9f73-c2b9640f2d4a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:48.543912 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1899d865-5f07-4868-9f73-c2b9640f2d4a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1546 microversion: 2.1 time: 0.239834 Feb 17 03:31:48.544477 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 305/593] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:48 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1546 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:48.563405 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-029c6674-0dce-4aa8-b026-cf879852c09a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:48.563987 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-029c6674-0dce-4aa8-b026-cf879852c09a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:48.572262 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-029c6674-0dce-4aa8-b026-cf879852c09a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:48.572762 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-029c6674-0dce-4aa8-b026-cf879852c09a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:48.573626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-029c6674-0dce-4aa8-b026-cf879852c09a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:48.574107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-029c6674-0dce-4aa8-b026-cf879852c09a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:48.745108 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c89e24cc-706c-4b4e-acd8-5d9ee1103a0b tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:48.745786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c89e24cc-706c-4b4e-acd8-5d9ee1103a0b tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:48.746886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-029c6674-0dce-4aa8-b026-cf879852c09a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] HTTP exception thrown: Cannot 'detach_volume' instance b4d58358-22a0-4562-9370-9574a29ec572 while it is in vm_state rescued Feb 17 03:31:48.747544 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-029c6674-0dce-4aa8-b026-cf879852c09a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Returning 409 to user: Cannot 'detach_volume' instance b4d58358-22a0-4562-9370-9574a29ec572 while it is in vm_state rescued {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:31:48.748438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-029c6674-0dce-4aa8-b026-cf879852c09a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572/os-volume_attachments/9be22d5c-de27-441f-bb4c-f65e9b205744" status: 409 len: 152 microversion: 2.1 time: 0.189738 Feb 17 03:31:48.749057 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 289/594] 10.222.0.57 () {58 vars in 1406 bytes} [Wed Feb 17 03:31:48 2021] DELETE /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572/os-volume_attachments/9be22d5c-de27-441f-bb4c-f65e9b205744 => generated 152 bytes in 191 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 17 03:31:48.753646 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c89e24cc-706c-4b4e-acd8-5d9ee1103a0b tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:48.754154 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c89e24cc-706c-4b4e-acd8-5d9ee1103a0b tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:48.754999 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c89e24cc-706c-4b4e-acd8-5d9ee1103a0b tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:48.755491 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c89e24cc-706c-4b4e-acd8-5d9ee1103a0b tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:48.757927 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-38435929-e5cc-4ec9-bad4-8d0ff531a8a8 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:48.758626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-38435929-e5cc-4ec9-bad4-8d0ff531a8a8 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:48.766705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-38435929-e5cc-4ec9-bad4-8d0ff531a8a8 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:48.767215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-38435929-e5cc-4ec9-bad4-8d0ff531a8a8 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:48.768050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-38435929-e5cc-4ec9-bad4-8d0ff531a8a8 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:48.768661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-38435929-e5cc-4ec9-bad4-8d0ff531a8a8 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:48.891912 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c89e24cc-706c-4b4e-acd8-5d9ee1103a0b tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:48.902518 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c89e24cc-706c-4b4e-acd8-5d9ee1103a0b tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1270 microversion: 2.1 time: 0.161323 Feb 17 03:31:48.903558 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 306/595] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:48 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:31:48.919074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-38435929-e5cc-4ec9-bad4-8d0ff531a8a8 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "POST /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572/action" status: 202 len: 0 microversion: 2.1 time: 0.164967 Feb 17 03:31:48.919978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 290/596] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:48 2021] POST /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:31:48.929220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e6bbfe29-1a1e-4c86-806c-6e09b217ce03 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:48.929888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e6bbfe29-1a1e-4c86-806c-6e09b217ce03 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:48.939057 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e6bbfe29-1a1e-4c86-806c-6e09b217ce03 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:48.939572 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e6bbfe29-1a1e-4c86-806c-6e09b217ce03 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:48.940641 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e6bbfe29-1a1e-4c86-806c-6e09b217ce03 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:48.941198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e6bbfe29-1a1e-4c86-806c-6e09b217ce03 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:48.958496 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d6b50595-48aa-4039-b2ec-91d066e22ed7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:48.959934 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d6b50595-48aa-4039-b2ec-91d066e22ed7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:48.968661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d6b50595-48aa-4039-b2ec-91d066e22ed7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:48.969288 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d6b50595-48aa-4039-b2ec-91d066e22ed7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:48.970202 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d6b50595-48aa-4039-b2ec-91d066e22ed7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:48.970768 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d6b50595-48aa-4039-b2ec-91d066e22ed7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:49.119634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d6b50595-48aa-4039-b2ec-91d066e22ed7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.165374 Feb 17 03:31:49.120747 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 291/597] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:48 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:49.126612 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-30129fe7-5b66-4242-8a5b-6044fc1c6117 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:49.127809 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-30129fe7-5b66-4242-8a5b-6044fc1c6117 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:49.139638 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30129fe7-5b66-4242-8a5b-6044fc1c6117 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:49.140236 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30129fe7-5b66-4242-8a5b-6044fc1c6117 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:49.141740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30129fe7-5b66-4242-8a5b-6044fc1c6117 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:49.142312 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30129fe7-5b66-4242-8a5b-6044fc1c6117 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:49.288438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-30129fe7-5b66-4242-8a5b-6044fc1c6117 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.166080 Feb 17 03:31:49.292785 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 292/598] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:49 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:49.320520 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-772e46bd-e635-4afd-802c-7e2fdcdd7c90 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:49.321950 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-772e46bd-e635-4afd-802c-7e2fdcdd7c90 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:49.331149 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-772e46bd-e635-4afd-802c-7e2fdcdd7c90 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:49.331795 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-772e46bd-e635-4afd-802c-7e2fdcdd7c90 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:49.332749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-772e46bd-e635-4afd-802c-7e2fdcdd7c90 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:49.333373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-772e46bd-e635-4afd-802c-7e2fdcdd7c90 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:49.545588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e6bbfe29-1a1e-4c86-806c-6e09b217ce03 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:49.556190 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e6bbfe29-1a1e-4c86-806c-6e09b217ce03 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1554 microversion: 2.1 time: 0.630603 Feb 17 03:31:49.556971 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 307/599] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:48 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1554 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:49.562682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-772e46bd-e635-4afd-802c-7e2fdcdd7c90 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:49.572620 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-772e46bd-e635-4afd-802c-7e2fdcdd7c90 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1317 microversion: 2.1 time: 0.261042 Feb 17 03:31:49.573266 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 293/600] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:49 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:31:49.922094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4d253bb8-7670-407a-ab60-9fc8f84f7beb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:49.922762 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4d253bb8-7670-407a-ab60-9fc8f84f7beb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:49.931386 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4d253bb8-7670-407a-ab60-9fc8f84f7beb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:49.931889 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4d253bb8-7670-407a-ab60-9fc8f84f7beb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:49.932754 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4d253bb8-7670-407a-ab60-9fc8f84f7beb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:49.933316 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4d253bb8-7670-407a-ab60-9fc8f84f7beb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:50.085044 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4d253bb8-7670-407a-ab60-9fc8f84f7beb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:50.094420 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4d253bb8-7670-407a-ab60-9fc8f84f7beb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1276 microversion: 2.1 time: 0.176502 Feb 17 03:31:50.095016 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 308/601] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:49 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:50.131507 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-40a3a615-b39a-4a13-b62d-28c02e62be38 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:50.132683 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-40a3a615-b39a-4a13-b62d-28c02e62be38 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:50.141180 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-40a3a615-b39a-4a13-b62d-28c02e62be38 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:50.141762 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-40a3a615-b39a-4a13-b62d-28c02e62be38 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:50.142668 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-40a3a615-b39a-4a13-b62d-28c02e62be38 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:50.143158 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-40a3a615-b39a-4a13-b62d-28c02e62be38 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:50.300309 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-382d596d-1ed4-4831-b730-c2f3ef4620d6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:50.301395 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-382d596d-1ed4-4831-b730-c2f3ef4620d6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:50.309559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-382d596d-1ed4-4831-b730-c2f3ef4620d6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:50.310190 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-382d596d-1ed4-4831-b730-c2f3ef4620d6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:50.311167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-382d596d-1ed4-4831-b730-c2f3ef4620d6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:50.311742 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-382d596d-1ed4-4831-b730-c2f3ef4620d6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:50.331061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-40a3a615-b39a-4a13-b62d-28c02e62be38 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.203358 Feb 17 03:31:50.333005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 294/602] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:50 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:31:50.436913 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-382d596d-1ed4-4831-b730-c2f3ef4620d6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.140351 Feb 17 03:31:50.441270 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 309/603] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:50 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:31:50.577099 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-73b02f19-a190-4031-bbd3-11213a5b4d3c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:50.577852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-73b02f19-a190-4031-bbd3-11213a5b4d3c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:50.586849 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73b02f19-a190-4031-bbd3-11213a5b4d3c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:50.587855 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73b02f19-a190-4031-bbd3-11213a5b4d3c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:50.588712 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73b02f19-a190-4031-bbd3-11213a5b4d3c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:50.589231 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73b02f19-a190-4031-bbd3-11213a5b4d3c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:50.593065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d973ecc2-b988-4342-b7d2-685060bb17d6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:50.593868 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d973ecc2-b988-4342-b7d2-685060bb17d6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:50.603478 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d973ecc2-b988-4342-b7d2-685060bb17d6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:50.603997 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d973ecc2-b988-4342-b7d2-685060bb17d6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:50.604864 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d973ecc2-b988-4342-b7d2-685060bb17d6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:50.605396 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d973ecc2-b988-4342-b7d2-685060bb17d6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:50.811012 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-73b02f19-a190-4031-bbd3-11213a5b4d3c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:50.820907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-73b02f19-a190-4031-bbd3-11213a5b4d3c tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1554 microversion: 2.1 time: 0.248290 Feb 17 03:31:50.821644 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 295/604] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:50 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1554 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:50.972327 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d973ecc2-b988-4342-b7d2-685060bb17d6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:50.982087 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d973ecc2-b988-4342-b7d2-685060bb17d6 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1317 microversion: 2.1 time: 0.395240 Feb 17 03:31:50.982679 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 310/605] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:50 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:31:51.113669 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5a3d9228-1ef5-47a2-96c1-b40079eb24d3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:51.114290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5a3d9228-1ef5-47a2-96c1-b40079eb24d3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:51.122109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a3d9228-1ef5-47a2-96c1-b40079eb24d3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:51.122603 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a3d9228-1ef5-47a2-96c1-b40079eb24d3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:51.123433 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a3d9228-1ef5-47a2-96c1-b40079eb24d3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:51.123916 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a3d9228-1ef5-47a2-96c1-b40079eb24d3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:51.343050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5a3d9228-1ef5-47a2-96c1-b40079eb24d3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:51.344852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7598f4fb-3b24-40c8-a50f-663fc0158e25 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:51.345990 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7598f4fb-3b24-40c8-a50f-663fc0158e25 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:51.354018 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5a3d9228-1ef5-47a2-96c1-b40079eb24d3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1318 microversion: 2.1 time: 0.244283 Feb 17 03:31:51.355035 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7598f4fb-3b24-40c8-a50f-663fc0158e25 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:51.355633 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7598f4fb-3b24-40c8-a50f-663fc0158e25 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:51.356483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7598f4fb-3b24-40c8-a50f-663fc0158e25 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:51.356984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7598f4fb-3b24-40c8-a50f-663fc0158e25 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:51.364906 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 296/606] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:51 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:51.450283 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c427eea5-382f-4d93-b4f1-437bbf6e17c0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:51.451597 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c427eea5-382f-4d93-b4f1-437bbf6e17c0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:51.459832 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c427eea5-382f-4d93-b4f1-437bbf6e17c0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:51.460336 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c427eea5-382f-4d93-b4f1-437bbf6e17c0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:51.461209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c427eea5-382f-4d93-b4f1-437bbf6e17c0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:51.461741 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c427eea5-382f-4d93-b4f1-437bbf6e17c0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:51.621608 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7598f4fb-3b24-40c8-a50f-663fc0158e25 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.281034 Feb 17 03:31:51.626597 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 311/607] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:51 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:31:51.654402 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c427eea5-382f-4d93-b4f1-437bbf6e17c0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.208801 Feb 17 03:31:51.655121 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 297/608] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:51 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:31:51.839907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-6cc18d79-1d64-40f0-b836-7fa91b82c70a req-ee54ce93-21b6-47f6-a939-0bded5988cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f", "name": "network-vif-plugged", "status": "completed", "tag": "2695e8c8-f6c0-48e2-9f5f-06e7275761a5"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:51.841344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-013fda7b-e6b6-411f-9c6f-569ac3998937 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:51.841608 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:31:51.841608 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:31:51.842887 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-013fda7b-e6b6-411f-9c6f-569ac3998937 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:51.853070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-013fda7b-e6b6-411f-9c6f-569ac3998937 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:51.854055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-013fda7b-e6b6-411f-9c6f-569ac3998937 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:51.855138 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-013fda7b-e6b6-411f-9c6f-569ac3998937 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:51.855828 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-013fda7b-e6b6-411f-9c6f-569ac3998937 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:51.886417 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-6cc18d79-1d64-40f0-b836-7fa91b82c70a req-ee54ce93-21b6-47f6-a939-0bded5988cad service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:51.887814 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-6cc18d79-1d64-40f0-b836-7fa91b82c70a req-ee54ce93-21b6-47f6-a939-0bded5988cad service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:51.907766 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-6cc18d79-1d64-40f0-b836-7fa91b82c70a req-ee54ce93-21b6-47f6-a939-0bded5988cad service nova] Creating event network-vif-plugged:2695e8c8-f6c0-48e2-9f5f-06e7275761a5 for instance 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f on hv-cinder-75994 Feb 17 03:31:51.927894 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-6cc18d79-1d64-40f0-b836-7fa91b82c70a req-ee54ce93-21b6-47f6-a939-0bded5988cad service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092170 Feb 17 03:31:51.928828 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 312/609] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:31:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:31:52.003735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f7dfe77f-9a05-4073-b860-7130192be06e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:52.005206 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f7dfe77f-9a05-4073-b860-7130192be06e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:52.030323 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7dfe77f-9a05-4073-b860-7130192be06e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:52.031376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7dfe77f-9a05-4073-b860-7130192be06e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:52.032293 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7dfe77f-9a05-4073-b860-7130192be06e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:52.032800 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7dfe77f-9a05-4073-b860-7130192be06e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:52.130331 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-013fda7b-e6b6-411f-9c6f-569ac3998937 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:52.141527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-013fda7b-e6b6-411f-9c6f-569ac3998937 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1554 microversion: 2.1 time: 0.305375 Feb 17 03:31:52.142561 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 298/610] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:51 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1554 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:52.374293 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-39805c8a-c9f8-4a06-8b59-ebecf3d9efa2 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:52.374963 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-39805c8a-c9f8-4a06-8b59-ebecf3d9efa2 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:52.382867 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-39805c8a-c9f8-4a06-8b59-ebecf3d9efa2 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:52.383381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-39805c8a-c9f8-4a06-8b59-ebecf3d9efa2 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:52.384217 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-39805c8a-c9f8-4a06-8b59-ebecf3d9efa2 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:52.384710 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-39805c8a-c9f8-4a06-8b59-ebecf3d9efa2 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:52.605309 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-39805c8a-c9f8-4a06-8b59-ebecf3d9efa2 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:52.614297 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-39805c8a-c9f8-4a06-8b59-ebecf3d9efa2 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1318 microversion: 2.1 time: 0.244274 Feb 17 03:31:52.614893 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 299/611] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:52 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:52.635370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c555d9c5-cf04-4656-b3a7-51681580694f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:52.637286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c555d9c5-cf04-4656-b3a7-51681580694f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:52.645641 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c555d9c5-cf04-4656-b3a7-51681580694f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:52.646224 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c555d9c5-cf04-4656-b3a7-51681580694f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:52.647219 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c555d9c5-cf04-4656-b3a7-51681580694f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:52.647701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c555d9c5-cf04-4656-b3a7-51681580694f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:52.652495 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f7dfe77f-9a05-4073-b860-7130192be06e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:52.662788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f7dfe77f-9a05-4073-b860-7130192be06e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1317 microversion: 2.1 time: 0.665451 Feb 17 03:31:52.673571 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 313/612] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:51 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1317 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:31:52.673571 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cf5af579-0f59-4c65-9a9e-b643a8262906 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:52.673571 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cf5af579-0f59-4c65-9a9e-b643a8262906 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:52.679272 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cf5af579-0f59-4c65-9a9e-b643a8262906 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:52.680077 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cf5af579-0f59-4c65-9a9e-b643a8262906 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:52.681082 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cf5af579-0f59-4c65-9a9e-b643a8262906 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:52.681667 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cf5af579-0f59-4c65-9a9e-b643a8262906 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:53.516920 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cf5af579-0f59-4c65-9a9e-b643a8262906 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.851773 Feb 17 03:31:53.517503 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 314/613] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:52 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:53.522896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-65b268fe-77a1-44bf-bd53-23fc59ac9eea tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:53.523670 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-65b268fe-77a1-44bf-bd53-23fc59ac9eea tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:53.532538 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-65b268fe-77a1-44bf-bd53-23fc59ac9eea tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:53.533080 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-65b268fe-77a1-44bf-bd53-23fc59ac9eea tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:53.533948 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-65b268fe-77a1-44bf-bd53-23fc59ac9eea tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:53.534445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-65b268fe-77a1-44bf-bd53-23fc59ac9eea tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:53.562859 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c555d9c5-cf04-4656-b3a7-51681580694f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.931557 Feb 17 03:31:53.567286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 300/614] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:52 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:31:53.569496 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-20e3d372-f5f5-419a-9d3b-4374da281d5a req-b27398ec-0993-477d-8e55-50cf6c3ab422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed26f5aa-77e4-4e92-b7bf-20ae530ebe42", "tag": "859d2cf9-e281-49ce-9ffd-0ab7067e438e"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:53.571404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:31:53.571404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:31:53.581861 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-20e3d372-f5f5-419a-9d3b-4374da281d5a req-b27398ec-0993-477d-8e55-50cf6c3ab422 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:53.582370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-20e3d372-f5f5-419a-9d3b-4374da281d5a req-b27398ec-0993-477d-8e55-50cf6c3ab422 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:53.600114 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-20e3d372-f5f5-419a-9d3b-4374da281d5a req-b27398ec-0993-477d-8e55-50cf6c3ab422 service nova] Creating event network-changed:859d2cf9-e281-49ce-9ffd-0ab7067e438e for instance ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 on hv-cinder-75994 Feb 17 03:31:53.613050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-20e3d372-f5f5-419a-9d3b-4374da281d5a req-b27398ec-0993-477d-8e55-50cf6c3ab422 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047719 Feb 17 03:31:53.613698 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 301/615] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:31:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:31:53.632307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a3003223-5ae5-4dbe-b81f-6f125320601e tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:53.633092 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a3003223-5ae5-4dbe-b81f-6f125320601e tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:53.641756 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a3003223-5ae5-4dbe-b81f-6f125320601e tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:53.642233 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a3003223-5ae5-4dbe-b81f-6f125320601e tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:53.643058 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a3003223-5ae5-4dbe-b81f-6f125320601e tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:53.643743 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a3003223-5ae5-4dbe-b81f-6f125320601e tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:53.801135 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-65b268fe-77a1-44bf-bd53-23fc59ac9eea tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:53.811738 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-65b268fe-77a1-44bf-bd53-23fc59ac9eea tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1554 microversion: 2.1 time: 0.293034 Feb 17 03:31:53.812320 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 315/616] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:53 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1554 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:53.817381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ba34a346-5b1d-4b76-bd9a-06b002761440 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:53.818211 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ba34a346-5b1d-4b76-bd9a-06b002761440 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:53.826962 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ba34a346-5b1d-4b76-bd9a-06b002761440 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:53.827476 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ba34a346-5b1d-4b76-bd9a-06b002761440 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:53.828321 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ba34a346-5b1d-4b76-bd9a-06b002761440 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:53.828812 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ba34a346-5b1d-4b76-bd9a-06b002761440 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:53.867107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a3003223-5ae5-4dbe-b81f-6f125320601e tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:53.890809 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a3003223-5ae5-4dbe-b81f-6f125320601e tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1318 microversion: 2.1 time: 0.262614 Feb 17 03:31:53.891410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 302/617] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:53 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:31:54.257284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ba34a346-5b1d-4b76-bd9a-06b002761440 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:54.266143 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ba34a346-5b1d-4b76-bd9a-06b002761440 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1317 microversion: 2.1 time: 0.452615 Feb 17 03:31:54.266741 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 316/618] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:53 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:54.528632 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f86da3b1-c163-46a2-9b81-ef963dd669cc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:54.529709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f86da3b1-c163-46a2-9b81-ef963dd669cc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:54.537512 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f86da3b1-c163-46a2-9b81-ef963dd669cc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:54.538021 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f86da3b1-c163-46a2-9b81-ef963dd669cc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:54.538902 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f86da3b1-c163-46a2-9b81-ef963dd669cc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:54.539396 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f86da3b1-c163-46a2-9b81-ef963dd669cc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:54.576236 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-45cd06cf-f435-45fc-83c5-a1d23a8452ca tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:54.577400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-45cd06cf-f435-45fc-83c5-a1d23a8452ca tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:54.585717 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45cd06cf-f435-45fc-83c5-a1d23a8452ca tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:54.586232 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45cd06cf-f435-45fc-83c5-a1d23a8452ca tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:54.587122 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45cd06cf-f435-45fc-83c5-a1d23a8452ca tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:54.588146 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45cd06cf-f435-45fc-83c5-a1d23a8452ca tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:55.331432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f86da3b1-c163-46a2-9b81-ef963dd669cc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.807114 Feb 17 03:31:55.332127 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 303/619] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:54 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:55.337859 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f5d8adde-c9bd-41ea-ad09-880a4566d0d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:55.338633 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f5d8adde-c9bd-41ea-ad09-880a4566d0d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:55.347067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f5d8adde-c9bd-41ea-ad09-880a4566d0d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:55.347577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f5d8adde-c9bd-41ea-ad09-880a4566d0d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:55.348425 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f5d8adde-c9bd-41ea-ad09-880a4566d0d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:55.348920 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f5d8adde-c9bd-41ea-ad09-880a4566d0d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:55.364943 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-45cd06cf-f435-45fc-83c5-a1d23a8452ca tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.793252 Feb 17 03:31:55.366035 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 317/620] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:54 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:31:55.371571 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-658f12e8-1cf3-4fb4-8023-2b4236d88cd3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:55.372323 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-658f12e8-1cf3-4fb4-8023-2b4236d88cd3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:55.380717 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-658f12e8-1cf3-4fb4-8023-2b4236d88cd3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:55.381287 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-658f12e8-1cf3-4fb4-8023-2b4236d88cd3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:55.382115 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-658f12e8-1cf3-4fb4-8023-2b4236d88cd3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:55.382601 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-658f12e8-1cf3-4fb4-8023-2b4236d88cd3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:55.585289 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f5d8adde-c9bd-41ea-ad09-880a4566d0d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:55.594923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f5d8adde-c9bd-41ea-ad09-880a4566d0d5 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1554 microversion: 2.1 time: 0.261386 Feb 17 03:31:55.595523 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 304/621] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:55 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1554 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:55.600151 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8203dfce-8670-45cd-8868-a9e645814b4e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:55.600956 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8203dfce-8670-45cd-8868-a9e645814b4e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:55.612445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8203dfce-8670-45cd-8868-a9e645814b4e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:55.612960 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8203dfce-8670-45cd-8868-a9e645814b4e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:55.613837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8203dfce-8670-45cd-8868-a9e645814b4e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:55.614333 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8203dfce-8670-45cd-8868-a9e645814b4e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:55.635160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-658f12e8-1cf3-4fb4-8023-2b4236d88cd3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:55.644159 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-658f12e8-1cf3-4fb4-8023-2b4236d88cd3 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1318 microversion: 2.1 time: 0.277277 Feb 17 03:31:55.644758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 318/622] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:55 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:55.824949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8203dfce-8670-45cd-8868-a9e645814b4e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:55.833923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8203dfce-8670-45cd-8868-a9e645814b4e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1506 microversion: 2.1 time: 0.237325 Feb 17 03:31:55.834459 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 305/623] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:55 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:56.344677 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ee489100-8512-4e8c-bed1-ee13132230a1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:56.345897 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ee489100-8512-4e8c-bed1-ee13132230a1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:56.353769 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee489100-8512-4e8c-bed1-ee13132230a1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:56.354270 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee489100-8512-4e8c-bed1-ee13132230a1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:56.355106 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee489100-8512-4e8c-bed1-ee13132230a1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:56.355601 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee489100-8512-4e8c-bed1-ee13132230a1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:56.381786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c6fc4742-5bd8-4045-930a-7390ac8fcdcf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:56.383208 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c6fc4742-5bd8-4045-930a-7390ac8fcdcf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:56.392657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c6fc4742-5bd8-4045-930a-7390ac8fcdcf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:56.393148 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c6fc4742-5bd8-4045-930a-7390ac8fcdcf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:56.394008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c6fc4742-5bd8-4045-930a-7390ac8fcdcf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:56.394497 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c6fc4742-5bd8-4045-930a-7390ac8fcdcf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:56.603641 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ee489100-8512-4e8c-bed1-ee13132230a1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.262768 Feb 17 03:31:56.604650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 319/624] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:56 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:56.613899 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-95c2fbc2-7ce0-4500-adf0-bf47ffc565b2 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:56.614669 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-95c2fbc2-7ce0-4500-adf0-bf47ffc565b2 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:56.622935 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c6fc4742-5bd8-4045-930a-7390ac8fcdcf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.249098 Feb 17 03:31:56.627075 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 306/625] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:56 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:31:56.627259 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95c2fbc2-7ce0-4500-adf0-bf47ffc565b2 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:56.627259 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95c2fbc2-7ce0-4500-adf0-bf47ffc565b2 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:56.627259 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95c2fbc2-7ce0-4500-adf0-bf47ffc565b2 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:56.627259 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95c2fbc2-7ce0-4500-adf0-bf47ffc565b2 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:56.662185 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-43bf5c2f-dab1-43c8-8db5-ff16b0a1ba00 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:56.662949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-43bf5c2f-dab1-43c8-8db5-ff16b0a1ba00 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:56.671280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43bf5c2f-dab1-43c8-8db5-ff16b0a1ba00 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:56.671826 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43bf5c2f-dab1-43c8-8db5-ff16b0a1ba00 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:56.672661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43bf5c2f-dab1-43c8-8db5-ff16b0a1ba00 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:56.673170 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43bf5c2f-dab1-43c8-8db5-ff16b0a1ba00 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:56.867268 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-95c2fbc2-7ce0-4500-adf0-bf47ffc565b2 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:56.884209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-95c2fbc2-7ce0-4500-adf0-bf47ffc565b2 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1554 microversion: 2.1 time: 0.273902 Feb 17 03:31:56.885328 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 320/626] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:56 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1554 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:31:56.910551 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-43bf5c2f-dab1-43c8-8db5-ff16b0a1ba00 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:56.921323 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-43bf5c2f-dab1-43c8-8db5-ff16b0a1ba00 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1318 microversion: 2.1 time: 0.263873 Feb 17 03:31:56.922220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 307/627] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:56 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:31:57.615816 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0a0b2bae-8676-4c1f-bc6a-dc3640aa3b56 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:57.616855 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0a0b2bae-8676-4c1f-bc6a-dc3640aa3b56 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:57.625707 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a0b2bae-8676-4c1f-bc6a-dc3640aa3b56 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:57.626216 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a0b2bae-8676-4c1f-bc6a-dc3640aa3b56 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:57.627053 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a0b2bae-8676-4c1f-bc6a-dc3640aa3b56 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:57.627547 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a0b2bae-8676-4c1f-bc6a-dc3640aa3b56 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:57.635649 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9e338e50-25d2-4c96-9b5e-e7b79306d8cd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:57.636715 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9e338e50-25d2-4c96-9b5e-e7b79306d8cd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:57.644397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9e338e50-25d2-4c96-9b5e-e7b79306d8cd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:57.644897 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9e338e50-25d2-4c96-9b5e-e7b79306d8cd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:57.645755 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9e338e50-25d2-4c96-9b5e-e7b79306d8cd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:57.646244 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9e338e50-25d2-4c96-9b5e-e7b79306d8cd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:57.953332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0a0b2bae-8676-4c1f-bc6a-dc3640aa3b56 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.341257 Feb 17 03:31:57.954004 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 321/628] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:57 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:57.959625 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8f74305d-c8af-4871-831e-6fff71733be6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:57.960385 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8f74305d-c8af-4871-831e-6fff71733be6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:57.969633 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f74305d-c8af-4871-831e-6fff71733be6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:57.970148 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f74305d-c8af-4871-831e-6fff71733be6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:57.970988 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f74305d-c8af-4871-831e-6fff71733be6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:57.971482 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f74305d-c8af-4871-831e-6fff71733be6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:57.975988 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9e338e50-25d2-4c96-9b5e-e7b79306d8cd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.344567 Feb 17 03:31:57.978107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 308/629] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:57 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:31:57.984035 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3886e15f-8478-4140-85e9-1c48d7939f4c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:57.984815 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3886e15f-8478-4140-85e9-1c48d7939f4c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:57.992889 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3886e15f-8478-4140-85e9-1c48d7939f4c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:57.993929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3886e15f-8478-4140-85e9-1c48d7939f4c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:57.994783 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3886e15f-8478-4140-85e9-1c48d7939f4c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:57.995268 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3886e15f-8478-4140-85e9-1c48d7939f4c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:58.190044 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8f74305d-c8af-4871-831e-6fff71733be6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:58.200450 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8f74305d-c8af-4871-831e-6fff71733be6 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1560 microversion: 2.1 time: 0.244974 Feb 17 03:31:58.201057 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 322/630] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:57 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1560 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:58.317516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-dc70605b-acf0-4cf7-972c-af91a34bccf4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:58.318055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-dc70605b-acf0-4cf7-972c-af91a34bccf4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:58.326588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dc70605b-acf0-4cf7-972c-af91a34bccf4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:58.327090 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dc70605b-acf0-4cf7-972c-af91a34bccf4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:58.327919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dc70605b-acf0-4cf7-972c-af91a34bccf4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:58.328406 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dc70605b-acf0-4cf7-972c-af91a34bccf4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:58.348966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3886e15f-8478-4140-85e9-1c48d7939f4c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:58.358336 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3886e15f-8478-4140-85e9-1c48d7939f4c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1318 microversion: 2.1 time: 0.379980 Feb 17 03:31:58.358941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 309/631] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:57 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:31:58.485598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-31b08d85-709c-4981-ae99-0054eb07280d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dca0c077-7e32-4870-b50d-47b6488e08d1"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:58.486792 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-31b08d85-709c-4981-ae99-0054eb07280d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:58.495207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-31b08d85-709c-4981-ae99-0054eb07280d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:58.495728 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-31b08d85-709c-4981-ae99-0054eb07280d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:58.496544 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-31b08d85-709c-4981-ae99-0054eb07280d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:58.497055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-31b08d85-709c-4981-ae99-0054eb07280d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:58.508072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-dc70605b-acf0-4cf7-972c-af91a34bccf4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lazy-loading 'services' on Instance uuid b4d58358-22a0-4562-9370-9574a29ec572 {{(pid=98104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:31:58.649217 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-dc70605b-acf0-4cf7-972c-af91a34bccf4 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572/os-volume_attachments/9be22d5c-de27-441f-bb4c-f65e9b205744" status: 202 len: 0 microversion: 2.1 time: 0.335258 Feb 17 03:31:58.649789 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 323/632] 10.222.0.57 () {58 vars in 1406 bytes} [Wed Feb 17 03:31:58 2021] DELETE /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572/os-volume_attachments/9be22d5c-de27-441f-bb4c-f65e9b205744 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:31:58.900783 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-31b08d85-709c-4981-ae99-0054eb07280d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "POST /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.419112 Feb 17 03:31:58.901473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 310/633] 10.222.0.57 () {60 vars in 1313 bytes} [Wed Feb 17 03:31:58 2021] POST /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:31:58.966978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cb2fbc08-6cd7-45be-8a40-3da0d8d8b7f7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:58.968230 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cb2fbc08-6cd7-45be-8a40-3da0d8d8b7f7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:58.977197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cb2fbc08-6cd7-45be-8a40-3da0d8d8b7f7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:58.978559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cb2fbc08-6cd7-45be-8a40-3da0d8d8b7f7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:58.979494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cb2fbc08-6cd7-45be-8a40-3da0d8d8b7f7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:58.979989 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cb2fbc08-6cd7-45be-8a40-3da0d8d8b7f7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:58.990060 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-356f0423-f9aa-47d4-87fc-5b7c6a8d61e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:31:58.991289 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-356f0423-f9aa-47d4-87fc-5b7c6a8d61e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:59.007727 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-356f0423-f9aa-47d4-87fc-5b7c6a8d61e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:59.007727 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-356f0423-f9aa-47d4-87fc-5b7c6a8d61e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:59.007727 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-356f0423-f9aa-47d4-87fc-5b7c6a8d61e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:59.007727 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-356f0423-f9aa-47d4-87fc-5b7c6a8d61e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:59.326772 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cb2fbc08-6cd7-45be-8a40-3da0d8d8b7f7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.364595 Feb 17 03:31:59.327410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 324/634] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:31:58 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:31:59.376669 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b4a0f7ef-0b26-4b18-a936-c5d5647cfd92 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:31:59.377447 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b4a0f7ef-0b26-4b18-a936-c5d5647cfd92 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:31:59.386365 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b4a0f7ef-0b26-4b18-a936-c5d5647cfd92 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:59.386866 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b4a0f7ef-0b26-4b18-a936-c5d5647cfd92 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:59.387691 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b4a0f7ef-0b26-4b18-a936-c5d5647cfd92 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:31:59.388189 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b4a0f7ef-0b26-4b18-a936-c5d5647cfd92 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:31:59.487170 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-356f0423-f9aa-47d4-87fc-5b7c6a8d61e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.501525 Feb 17 03:31:59.491470 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 311/635] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:31:58 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:31:59.599857 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b4a0f7ef-0b26-4b18-a936-c5d5647cfd92 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:31:59.609050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b4a0f7ef-0b26-4b18-a936-c5d5647cfd92 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1318 microversion: 2.1 time: 0.236541 Feb 17 03:31:59.609646 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 325/636] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:31:59 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:00.340441 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-85df6085-c2b6-4715-9f30-657af38f0d40 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:00.341728 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-85df6085-c2b6-4715-9f30-657af38f0d40 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:00.350031 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85df6085-c2b6-4715-9f30-657af38f0d40 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:00.350480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85df6085-c2b6-4715-9f30-657af38f0d40 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:00.351313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85df6085-c2b6-4715-9f30-657af38f0d40 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:00.351803 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85df6085-c2b6-4715-9f30-657af38f0d40 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:00.480588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-85df6085-c2b6-4715-9f30-657af38f0d40 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.145397 Feb 17 03:32:00.481584 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 312/637] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:00 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:00.499661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d9f9fa50-3d22-429b-b338-da897305569e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:00.500736 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d9f9fa50-3d22-429b-b338-da897305569e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:00.512482 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d9f9fa50-3d22-429b-b338-da897305569e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:00.512987 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d9f9fa50-3d22-429b-b338-da897305569e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:00.513857 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d9f9fa50-3d22-429b-b338-da897305569e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:00.514347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d9f9fa50-3d22-429b-b338-da897305569e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:00.628388 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-78960f98-d6d1-47d6-afd7-6083abf8b4ee tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:00.629181 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-78960f98-d6d1-47d6-afd7-6083abf8b4ee tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:00.638182 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-78960f98-d6d1-47d6-afd7-6083abf8b4ee tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:00.638684 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-78960f98-d6d1-47d6-afd7-6083abf8b4ee tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:00.639504 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-78960f98-d6d1-47d6-afd7-6083abf8b4ee tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:00.639984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-78960f98-d6d1-47d6-afd7-6083abf8b4ee tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:00.758067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d9f9fa50-3d22-429b-b338-da897305569e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.262227 Feb 17 03:32:00.760714 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 326/638] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:00 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:32:00.847837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-78960f98-d6d1-47d6-afd7-6083abf8b4ee tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:00.856645 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-78960f98-d6d1-47d6-afd7-6083abf8b4ee tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1318 microversion: 2.1 time: 0.232716 Feb 17 03:32:00.857434 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 313/639] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:00 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:01.494214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6c1fbb9b-2c28-4d41-ac5a-ee787779e895 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:01.495275 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6c1fbb9b-2c28-4d41-ac5a-ee787779e895 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:01.503832 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6c1fbb9b-2c28-4d41-ac5a-ee787779e895 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:01.504341 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6c1fbb9b-2c28-4d41-ac5a-ee787779e895 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:01.505203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6c1fbb9b-2c28-4d41-ac5a-ee787779e895 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:01.505700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6c1fbb9b-2c28-4d41-ac5a-ee787779e895 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:01.678250 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6c1fbb9b-2c28-4d41-ac5a-ee787779e895 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.189085 Feb 17 03:32:01.678977 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 327/640] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:01 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:01.770194 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e59d2614-9949-49db-af96-8ca990c98cfc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:01.771176 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e59d2614-9949-49db-af96-8ca990c98cfc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:01.780618 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e59d2614-9949-49db-af96-8ca990c98cfc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:01.781156 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e59d2614-9949-49db-af96-8ca990c98cfc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:01.781997 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e59d2614-9949-49db-af96-8ca990c98cfc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:01.782490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e59d2614-9949-49db-af96-8ca990c98cfc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:01.875105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-df422311-22b0-4741-8beb-8234290715fa tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:01.875918 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-df422311-22b0-4741-8beb-8234290715fa tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:01.884658 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-df422311-22b0-4741-8beb-8234290715fa tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:01.885206 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-df422311-22b0-4741-8beb-8234290715fa tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:01.886052 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-df422311-22b0-4741-8beb-8234290715fa tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:01.886550 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-df422311-22b0-4741-8beb-8234290715fa tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:02.000846 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e59d2614-9949-49db-af96-8ca990c98cfc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.234386 Feb 17 03:32:02.001682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 314/641] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:01 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:32:02.096048 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-df422311-22b0-4741-8beb-8234290715fa tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:02.104783 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-df422311-22b0-4741-8beb-8234290715fa tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1318 microversion: 2.1 time: 0.234524 Feb 17 03:32:02.105406 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 328/642] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:01 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:02.692258 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-dd492744-f1a9-4802-aa4e-e5926eb7f191 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:02.693412 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-dd492744-f1a9-4802-aa4e-e5926eb7f191 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:02.702825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dd492744-f1a9-4802-aa4e-e5926eb7f191 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:02.703326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dd492744-f1a9-4802-aa4e-e5926eb7f191 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:02.704213 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dd492744-f1a9-4802-aa4e-e5926eb7f191 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:02.704697 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dd492744-f1a9-4802-aa4e-e5926eb7f191 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:02.837937 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-dd492744-f1a9-4802-aa4e-e5926eb7f191 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.150255 Feb 17 03:32:02.838610 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 315/643] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:02 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:03.012139 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-da43a933-bbea-4120-a922-4621eee51fd0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:03.013205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-da43a933-bbea-4120-a922-4621eee51fd0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:03.021573 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da43a933-bbea-4120-a922-4621eee51fd0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:03.022076 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da43a933-bbea-4120-a922-4621eee51fd0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:03.022907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da43a933-bbea-4120-a922-4621eee51fd0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:03.023402 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da43a933-bbea-4120-a922-4621eee51fd0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:03.124092 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4c222e61-5536-4f74-a4a9-25a01cfe303f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:03.124865 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4c222e61-5536-4f74-a4a9-25a01cfe303f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:03.133441 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c222e61-5536-4f74-a4a9-25a01cfe303f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:03.133959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c222e61-5536-4f74-a4a9-25a01cfe303f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:03.134800 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c222e61-5536-4f74-a4a9-25a01cfe303f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:03.135298 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c222e61-5536-4f74-a4a9-25a01cfe303f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:03.186800 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-da43a933-bbea-4120-a922-4621eee51fd0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.178424 Feb 17 03:32:03.187501 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 329/644] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:03 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:32:03.344614 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4c222e61-5536-4f74-a4a9-25a01cfe303f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:03.353976 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4c222e61-5536-4f74-a4a9-25a01cfe303f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1318 microversion: 2.1 time: 0.235159 Feb 17 03:32:03.354593 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 316/645] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:03 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:03.459069 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e3a44b9f-5b91-4f26-b099-a87df6cc6292 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:03.459717 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e3a44b9f-5b91-4f26-b099-a87df6cc6292 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:03.468656 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e3a44b9f-5b91-4f26-b099-a87df6cc6292 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:03.469201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e3a44b9f-5b91-4f26-b099-a87df6cc6292 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:03.470038 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e3a44b9f-5b91-4f26-b099-a87df6cc6292 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:03.470529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e3a44b9f-5b91-4f26-b099-a87df6cc6292 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:03.534686 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e3a44b9f-5b91-4f26-b099-a87df6cc6292 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Going to try to terminate instance {{(pid=98104) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:32:03.650387 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e3a44b9f-5b91-4f26-b099-a87df6cc6292 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 204 len: 0 microversion: 2.1 time: 0.194831 Feb 17 03:32:03.651167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 330/646] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:32:03 2021] DELETE /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:32:03.660157 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-421c1bd2-b3ae-4e39-a49a-75b8b9e1b5a0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:03.660829 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-421c1bd2-b3ae-4e39-a49a-75b8b9e1b5a0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:03.668772 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-421c1bd2-b3ae-4e39-a49a-75b8b9e1b5a0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:03.669341 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-421c1bd2-b3ae-4e39-a49a-75b8b9e1b5a0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:03.670161 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-421c1bd2-b3ae-4e39-a49a-75b8b9e1b5a0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:03.670654 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-421c1bd2-b3ae-4e39-a49a-75b8b9e1b5a0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:03.850612 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-52c21dbc-974d-489f-b140-2cee6e562092 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:03.852161 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-52c21dbc-974d-489f-b140-2cee6e562092 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:03.860797 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-52c21dbc-974d-489f-b140-2cee6e562092 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:03.861472 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-52c21dbc-974d-489f-b140-2cee6e562092 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:03.862596 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-52c21dbc-974d-489f-b140-2cee6e562092 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:03.863367 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-52c21dbc-974d-489f-b140-2cee6e562092 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:03.881309 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-421c1bd2-b3ae-4e39-a49a-75b8b9e1b5a0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:03.890942 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-421c1bd2-b3ae-4e39-a49a-75b8b9e1b5a0 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1507 microversion: 2.1 time: 0.234737 Feb 17 03:32:03.891727 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 317/647] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:03 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:04.146067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-52c21dbc-974d-489f-b140-2cee6e562092 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.299868 Feb 17 03:32:04.146758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 331/648] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:03 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:32:04.200012 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4beacc6c-54ba-4497-b3b3-a75d13a9bbb9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:04.201205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4beacc6c-54ba-4497-b3b3-a75d13a9bbb9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:04.209612 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4beacc6c-54ba-4497-b3b3-a75d13a9bbb9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:04.210113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4beacc6c-54ba-4497-b3b3-a75d13a9bbb9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:04.210936 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4beacc6c-54ba-4497-b3b3-a75d13a9bbb9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:04.211422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4beacc6c-54ba-4497-b3b3-a75d13a9bbb9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:04.341664 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4beacc6c-54ba-4497-b3b3-a75d13a9bbb9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.146249 Feb 17 03:32:04.342381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 318/649] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:04 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:32:04.373294 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-080ef5d9-fc68-4a07-87da-d6c4629ac77d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:04.374010 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-080ef5d9-fc68-4a07-87da-d6c4629ac77d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:04.382543 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-080ef5d9-fc68-4a07-87da-d6c4629ac77d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:04.383056 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-080ef5d9-fc68-4a07-87da-d6c4629ac77d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:04.383898 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-080ef5d9-fc68-4a07-87da-d6c4629ac77d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:04.384437 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-080ef5d9-fc68-4a07-87da-d6c4629ac77d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:04.511414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-30d584c4-080d-43a7-b457-1b45ea6e1863 req-cf497265-efb4-46c0-b594-414274f522df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed26f5aa-77e4-4e92-b7bf-20ae530ebe42", "name": "network-vif-plugged", "status": "completed", "tag": "859d2cf9-e281-49ce-9ffd-0ab7067e438e"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:04.513474 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:04.513474 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:32:04.525663 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-30d584c4-080d-43a7-b457-1b45ea6e1863 req-cf497265-efb4-46c0-b594-414274f522df service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:04.526177 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-30d584c4-080d-43a7-b457-1b45ea6e1863 req-cf497265-efb4-46c0-b594-414274f522df service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:04.560013 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-30d584c4-080d-43a7-b457-1b45ea6e1863 req-cf497265-efb4-46c0-b594-414274f522df service nova] Creating event network-vif-plugged:859d2cf9-e281-49ce-9ffd-0ab7067e438e for instance ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 on hv-cinder-75994 Feb 17 03:32:04.560013 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-30d584c4-080d-43a7-b457-1b45ea6e1863 req-cf497265-efb4-46c0-b594-414274f522df service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052405 Feb 17 03:32:04.560013 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 319/650] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:32:04.606198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-080ef5d9-fc68-4a07-87da-d6c4629ac77d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:04.615292 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-080ef5d9-fc68-4a07-87da-d6c4629ac77d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1318 microversion: 2.1 time: 0.247206 Feb 17 03:32:04.615895 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 332/651] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:04 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:04.910616 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ad203f31-779f-44a2-921b-e8e628402792 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:04.911380 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ad203f31-779f-44a2-921b-e8e628402792 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:04.920109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad203f31-779f-44a2-921b-e8e628402792 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:04.920556 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad203f31-779f-44a2-921b-e8e628402792 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:04.921411 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad203f31-779f-44a2-921b-e8e628402792 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:04.921896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad203f31-779f-44a2-921b-e8e628402792 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:05.130648 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ad203f31-779f-44a2-921b-e8e628402792 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:05.139772 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ad203f31-779f-44a2-921b-e8e628402792 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1507 microversion: 2.1 time: 0.233614 Feb 17 03:32:05.140354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 320/652] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:04 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:05.158077 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-470a8190-f866-4b09-b8e6-cb0e8b0ca83d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:05.159117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-470a8190-f866-4b09-b8e6-cb0e8b0ca83d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:05.166899 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-470a8190-f866-4b09-b8e6-cb0e8b0ca83d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:05.167397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-470a8190-f866-4b09-b8e6-cb0e8b0ca83d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:05.168233 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-470a8190-f866-4b09-b8e6-cb0e8b0ca83d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:05.168720 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-470a8190-f866-4b09-b8e6-cb0e8b0ca83d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:05.354295 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e6fca082-d258-4089-985c-0f9362750ec9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:05.355429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e6fca082-d258-4089-985c-0f9362750ec9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:05.363377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e6fca082-d258-4089-985c-0f9362750ec9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:05.363881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e6fca082-d258-4089-985c-0f9362750ec9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:05.364717 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e6fca082-d258-4089-985c-0f9362750ec9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:05.365239 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e6fca082-d258-4089-985c-0f9362750ec9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:05.908164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-470a8190-f866-4b09-b8e6-cb0e8b0ca83d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.753782 Feb 17 03:32:05.908892 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 333/653] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:05 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:05.914220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ac98dc0a-4f33-43b8-8212-354c68d24795 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:05.914991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ac98dc0a-4f33-43b8-8212-354c68d24795 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:05.923520 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac98dc0a-4f33-43b8-8212-354c68d24795 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:05.924027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac98dc0a-4f33-43b8-8212-354c68d24795 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:05.924872 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac98dc0a-4f33-43b8-8212-354c68d24795 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:05.925400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac98dc0a-4f33-43b8-8212-354c68d24795 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:05.951666 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e6fca082-d258-4089-985c-0f9362750ec9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.601212 Feb 17 03:32:05.952671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 321/654] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:05 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:32:06.137082 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ac98dc0a-4f33-43b8-8212-354c68d24795 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:06.145773 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ac98dc0a-4f33-43b8-8212-354c68d24795 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1318 microversion: 2.1 time: 0.235654 Feb 17 03:32:06.146358 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 334/655] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:05 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:06.158755 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-68a3c8c5-cba3-40b5-91f5-8edcf0e674d8 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:06.159523 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-68a3c8c5-cba3-40b5-91f5-8edcf0e674d8 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:06.168059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-68a3c8c5-cba3-40b5-91f5-8edcf0e674d8 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:06.168554 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-68a3c8c5-cba3-40b5-91f5-8edcf0e674d8 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:06.169417 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-68a3c8c5-cba3-40b5-91f5-8edcf0e674d8 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:06.169903 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-68a3c8c5-cba3-40b5-91f5-8edcf0e674d8 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:06.377163 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-68a3c8c5-cba3-40b5-91f5-8edcf0e674d8 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:06.387316 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-68a3c8c5-cba3-40b5-91f5-8edcf0e674d8 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1507 microversion: 2.1 time: 0.233008 Feb 17 03:32:06.387973 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 322/656] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:06 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:06.920901 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d3f8aacc-89f9-4e20-8c7f-0f9303208994 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:06.921959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d3f8aacc-89f9-4e20-8c7f-0f9303208994 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:06.930290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d3f8aacc-89f9-4e20-8c7f-0f9303208994 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:06.930802 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d3f8aacc-89f9-4e20-8c7f-0f9303208994 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:06.932198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d3f8aacc-89f9-4e20-8c7f-0f9303208994 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:06.932697 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d3f8aacc-89f9-4e20-8c7f-0f9303208994 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:06.964096 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8836c701-6cec-48c0-bb19-2125c20dac6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:06.965209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8836c701-6cec-48c0-bb19-2125c20dac6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:06.972892 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8836c701-6cec-48c0-bb19-2125c20dac6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:06.973423 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8836c701-6cec-48c0-bb19-2125c20dac6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:06.974262 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8836c701-6cec-48c0-bb19-2125c20dac6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:06.974754 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8836c701-6cec-48c0-bb19-2125c20dac6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:07.145535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8836c701-6cec-48c0-bb19-2125c20dac6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.185784 Feb 17 03:32:07.146213 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 323/657] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:06 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:32:07.164008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-17247b27-36e0-4c68-bb36-6b06577b9a4d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:07.164764 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-17247b27-36e0-4c68-bb36-6b06577b9a4d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:07.173767 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-17247b27-36e0-4c68-bb36-6b06577b9a4d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:07.174214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-17247b27-36e0-4c68-bb36-6b06577b9a4d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:07.175057 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-17247b27-36e0-4c68-bb36-6b06577b9a4d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:07.175539 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-17247b27-36e0-4c68-bb36-6b06577b9a4d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:07.382730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-17247b27-36e0-4c68-bb36-6b06577b9a4d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:07.391840 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-17247b27-36e0-4c68-bb36-6b06577b9a4d tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1318 microversion: 2.1 time: 0.231924 Feb 17 03:32:07.392421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 324/658] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:07 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:07.402919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d3f8aacc-89f9-4e20-8c7f-0f9303208994 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.485936 Feb 17 03:32:07.403964 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 335/659] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:06 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:07.405793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4bb9080a-4cf0-4dfb-a72e-6b506bc81072 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:07.406463 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4bb9080a-4cf0-4dfb-a72e-6b506bc81072 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:07.414229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4bb9080a-4cf0-4dfb-a72e-6b506bc81072 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:07.414744 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4bb9080a-4cf0-4dfb-a72e-6b506bc81072 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:07.415583 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4bb9080a-4cf0-4dfb-a72e-6b506bc81072 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:07.416079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4bb9080a-4cf0-4dfb-a72e-6b506bc81072 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:07.624821 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4bb9080a-4cf0-4dfb-a72e-6b506bc81072 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:07.633661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4bb9080a-4cf0-4dfb-a72e-6b506bc81072 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1507 microversion: 2.1 time: 0.231674 Feb 17 03:32:07.634762 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 325/660] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:07 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:08.159021 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a8334518-b37b-40e9-a7e5-b0f37c58d7f7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:08.160157 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a8334518-b37b-40e9-a7e5-b0f37c58d7f7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:08.169164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a8334518-b37b-40e9-a7e5-b0f37c58d7f7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:08.169666 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a8334518-b37b-40e9-a7e5-b0f37c58d7f7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:08.170500 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a8334518-b37b-40e9-a7e5-b0f37c58d7f7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:08.170989 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a8334518-b37b-40e9-a7e5-b0f37c58d7f7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:08.337740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a8334518-b37b-40e9-a7e5-b0f37c58d7f7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.182975 Feb 17 03:32:08.338405 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 336/661] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:08 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:32:08.413908 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-333a1f1d-3bf2-4037-b26a-07bd7e9f6b3c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:08.414588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-333a1f1d-3bf2-4037-b26a-07bd7e9f6b3c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:08.416321 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c440e42b-3ba1-46ef-9181-78630857f5f7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:08.417714 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c440e42b-3ba1-46ef-9181-78630857f5f7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:08.423576 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-333a1f1d-3bf2-4037-b26a-07bd7e9f6b3c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:08.424066 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-333a1f1d-3bf2-4037-b26a-07bd7e9f6b3c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:08.424914 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-333a1f1d-3bf2-4037-b26a-07bd7e9f6b3c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:08.425433 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-333a1f1d-3bf2-4037-b26a-07bd7e9f6b3c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:08.426085 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c440e42b-3ba1-46ef-9181-78630857f5f7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:08.426600 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c440e42b-3ba1-46ef-9181-78630857f5f7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:08.427450 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c440e42b-3ba1-46ef-9181-78630857f5f7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:08.427943 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c440e42b-3ba1-46ef-9181-78630857f5f7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:08.641422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-333a1f1d-3bf2-4037-b26a-07bd7e9f6b3c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:08.651030 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-333a1f1d-3bf2-4037-b26a-07bd7e9f6b3c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1318 microversion: 2.1 time: 0.244572 Feb 17 03:32:08.651626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 326/662] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:08 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:08.656208 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b49067bb-d0bd-4e01-988a-6a7e6d61f9d3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:08.656872 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b49067bb-d0bd-4e01-988a-6a7e6d61f9d3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:08.664234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b49067bb-d0bd-4e01-988a-6a7e6d61f9d3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:08.664692 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b49067bb-d0bd-4e01-988a-6a7e6d61f9d3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:08.666169 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b49067bb-d0bd-4e01-988a-6a7e6d61f9d3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:08.666669 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b49067bb-d0bd-4e01-988a-6a7e6d61f9d3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:08.797529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c440e42b-3ba1-46ef-9181-78630857f5f7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.385982 Feb 17 03:32:08.798582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 337/663] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:08 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:32:08.880478 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b49067bb-d0bd-4e01-988a-6a7e6d61f9d3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:08.892354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b49067bb-d0bd-4e01-988a-6a7e6d61f9d3 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1507 microversion: 2.1 time: 0.239669 Feb 17 03:32:08.893493 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 327/664] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:08 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:09.350822 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-556a1b64-e748-4f21-bedb-ea5f7b0b1f5d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:09.352162 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-556a1b64-e748-4f21-bedb-ea5f7b0b1f5d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:09.360770 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-556a1b64-e748-4f21-bedb-ea5f7b0b1f5d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:09.361401 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-556a1b64-e748-4f21-bedb-ea5f7b0b1f5d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:09.362335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-556a1b64-e748-4f21-bedb-ea5f7b0b1f5d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:09.362960 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-556a1b64-e748-4f21-bedb-ea5f7b0b1f5d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:09.584024 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-556a1b64-e748-4f21-bedb-ea5f7b0b1f5d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.237514 Feb 17 03:32:09.588357 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 338/665] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:09 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:32:09.668688 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-397235c8-913f-4a6c-9db4-03463180e74f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:09.669417 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-397235c8-913f-4a6c-9db4-03463180e74f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:09.677453 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-397235c8-913f-4a6c-9db4-03463180e74f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:09.681741 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-397235c8-913f-4a6c-9db4-03463180e74f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:09.682776 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-397235c8-913f-4a6c-9db4-03463180e74f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:09.683275 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-397235c8-913f-4a6c-9db4-03463180e74f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:09.811096 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4eaa3f9a-498a-4163-81b8-da5383cf06e1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:09.812247 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4eaa3f9a-498a-4163-81b8-da5383cf06e1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:09.825296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4eaa3f9a-498a-4163-81b8-da5383cf06e1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:09.825794 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4eaa3f9a-498a-4163-81b8-da5383cf06e1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:09.826667 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4eaa3f9a-498a-4163-81b8-da5383cf06e1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:09.827172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4eaa3f9a-498a-4163-81b8-da5383cf06e1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:09.908048 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-397235c8-913f-4a6c-9db4-03463180e74f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:09.917545 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-397235c8-913f-4a6c-9db4-03463180e74f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1507 microversion: 2.1 time: 0.253394 Feb 17 03:32:09.918152 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 328/666] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:09 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:09.922902 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ab7022b3-3caa-4f08-88a0-530e17485cbc tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:09.923555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ab7022b3-3caa-4f08-88a0-530e17485cbc tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:09.931945 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ab7022b3-3caa-4f08-88a0-530e17485cbc tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:09.932444 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ab7022b3-3caa-4f08-88a0-530e17485cbc tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:09.933303 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ab7022b3-3caa-4f08-88a0-530e17485cbc tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:09.933798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ab7022b3-3caa-4f08-88a0-530e17485cbc tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:09.972074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4eaa3f9a-498a-4163-81b8-da5383cf06e1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.165913 Feb 17 03:32:09.976197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 339/667] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:09 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:32:09.979358 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0fff4d8a-4ace-48c7-b45b-8c5d259d2064 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ea053e7-e0e6-438b-a7a8-4703f63e8422", "device": "/dev/sdb"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:09.981177 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0fff4d8a-4ace-48c7-b45b-8c5d259d2064 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:09.990011 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0fff4d8a-4ace-48c7-b45b-8c5d259d2064 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:09.990517 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0fff4d8a-4ace-48c7-b45b-8c5d259d2064 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:09.991356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0fff4d8a-4ace-48c7-b45b-8c5d259d2064 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:09.991840 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0fff4d8a-4ace-48c7-b45b-8c5d259d2064 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:10.063503 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ab7022b3-3caa-4f08-88a0-530e17485cbc tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:10.073017 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ab7022b3-3caa-4f08-88a0-530e17485cbc tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 200 len: 1465 microversion: 2.1 time: 0.153736 Feb 17 03:32:10.073703 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 329/668] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:09 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 1465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:10.082662 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-626273e5-e96a-4d02-8189-a12e7b593a25 req-c0b1ef9d-bd34-4619-9925-02a39612ddfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d4f9c42-f07a-4f40-aad4-702d0fd26d82", "name": "network-vif-deleted", "tag": "c4b7f0c6-bfe4-49e1-936d-f15129c212a8"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:10.084542 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:10.084542 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:32:10.095130 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-626273e5-e96a-4d02-8189-a12e7b593a25 req-c0b1ef9d-bd34-4619-9925-02a39612ddfb service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:10.095635 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-626273e5-e96a-4d02-8189-a12e7b593a25 req-c0b1ef9d-bd34-4619-9925-02a39612ddfb service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:10.116170 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-626273e5-e96a-4d02-8189-a12e7b593a25 req-c0b1ef9d-bd34-4619-9925-02a39612ddfb service nova] Creating event network-vif-deleted:c4b7f0c6-bfe4-49e1-936d-f15129c212a8 for instance 4d4f9c42-f07a-4f40-aad4-702d0fd26d82 on hv-cinder-75994 Feb 17 03:32:10.122006 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-626273e5-e96a-4d02-8189-a12e7b593a25 req-c0b1ef9d-bd34-4619-9925-02a39612ddfb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046790 Feb 17 03:32:10.123397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 330/669] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:32:10.293230 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-88cde000-f787-4a55-b8f1-785e325a801a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:10.294436 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-88cde000-f787-4a55-b8f1-785e325a801a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:10.304320 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-88cde000-f787-4a55-b8f1-785e325a801a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:10.304978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-88cde000-f787-4a55-b8f1-785e325a801a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:10.306000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-88cde000-f787-4a55-b8f1-785e325a801a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:10.306498 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-88cde000-f787-4a55-b8f1-785e325a801a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:10.458222 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0fff4d8a-4ace-48c7-b45b-8c5d259d2064 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "POST /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.483501 Feb 17 03:32:10.458886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 340/670] 10.222.0.57 () {60 vars in 1313 bytes} [Wed Feb 17 03:32:09 2021] POST /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42/os-volume_attachments => generated 194 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:10.464923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1ecc68f1-8226-4daa-ad21-61d7c70dfc59 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-524884252", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-461955903", "security_groups": [{"name": "tempest-TestVolumeBootPattern-107357108"}], "block_device_mapping_v2": [{"uuid": "0587f459-8d6d-4266-8f32-d415c955e649", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3cb0cdf3-e2d2-4fae-b226-b086c7cc05ee"}]}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:10.494042 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-88cde000-f787-4a55-b8f1-785e325a801a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lazy-loading 'services' on Instance uuid 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:32:10.652663 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-88cde000-f787-4a55-b8f1-785e325a801a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f/os-volume_attachments/dca0c077-7e32-4870-b50d-47b6488e08d1" status: 202 len: 0 microversion: 2.1 time: 0.365760 Feb 17 03:32:10.655812 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-1ecc68f1-8226-4daa-ad21-61d7c70dfc59 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] validate_networks() for [('3cb0cdf3-e2d2-4fae-b226-b086c7cc05ee', None, None, None)] {{(pid=98104) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:32:10.661857 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 331/671] 10.222.0.57 () {58 vars in 1406 bytes} [Wed Feb 17 03:32:10 2021] DELETE /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f/os-volume_attachments/dca0c077-7e32-4870-b50d-47b6488e08d1 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:32:10.669318 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cf63ce9e-93ef-4a04-b48f-e2d07781640b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:10.670527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cf63ce9e-93ef-4a04-b48f-e2d07781640b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:10.680798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cf63ce9e-93ef-4a04-b48f-e2d07781640b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:10.682456 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cf63ce9e-93ef-4a04-b48f-e2d07781640b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:10.683836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cf63ce9e-93ef-4a04-b48f-e2d07781640b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:10.684635 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cf63ce9e-93ef-4a04-b48f-e2d07781640b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:10.883445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cf63ce9e-93ef-4a04-b48f-e2d07781640b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.219648 Feb 17 03:32:10.889245 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 332/672] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:10 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:32:10.986268 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-30e23f17-f173-44ec-8df9-27531144b3f3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:10.987411 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-30e23f17-f173-44ec-8df9-27531144b3f3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:10.995777 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30e23f17-f173-44ec-8df9-27531144b3f3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:10.996284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30e23f17-f173-44ec-8df9-27531144b3f3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:10.997161 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30e23f17-f173-44ec-8df9-27531144b3f3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:10.997654 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30e23f17-f173-44ec-8df9-27531144b3f3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:11.169564 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-30e23f17-f173-44ec-8df9-27531144b3f3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.188238 Feb 17 03:32:11.170305 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 333/673] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:10 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:32:11.176220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-575802f0-382d-49ec-b092-13a480d184ec tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:11.177007 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-575802f0-382d-49ec-b092-13a480d184ec tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: 4d4f9c42-f07a-4f40-aad4-702d0fd26d82] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:11.186310 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-575802f0-382d-49ec-b092-13a480d184ec tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:11.186823 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-575802f0-382d-49ec-b092-13a480d184ec tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:11.187685 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-575802f0-382d-49ec-b092-13a480d184ec tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:11.188181 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-575802f0-382d-49ec-b092-13a480d184ec tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:11.246505 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-575802f0-382d-49ec-b092-13a480d184ec tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] HTTP exception thrown: Instance 4d4f9c42-f07a-4f40-aad4-702d0fd26d82 could not be found. Feb 17 03:32:11.247185 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-575802f0-382d-49ec-b092-13a480d184ec tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Returning 404 to user: Instance 4d4f9c42-f07a-4f40-aad4-702d0fd26d82 could not be found. {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:32:11.248102 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-575802f0-382d-49ec-b092-13a480d184ec tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82" status: 404 len: 111 microversion: 2.1 time: 0.076610 Feb 17 03:32:11.248730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 334/674] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:11 2021] GET /compute/v2.1/servers/4d4f9c42-f07a-4f40-aad4-702d0fd26d82 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:32:11.256984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-30ce653b-6462-4bb4-9a7e-2be512fa51e1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:11.257531 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-30ce653b-6462-4bb4-9a7e-2be512fa51e1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:11.265900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30ce653b-6462-4bb4-9a7e-2be512fa51e1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:11.266416 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30ce653b-6462-4bb4-9a7e-2be512fa51e1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:11.267256 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30ce653b-6462-4bb4-9a7e-2be512fa51e1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:11.267746 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30ce653b-6462-4bb4-9a7e-2be512fa51e1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:11.332699 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-30ce653b-6462-4bb4-9a7e-2be512fa51e1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Going to try to terminate instance {{(pid=98103) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:32:11.447833 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-30ce653b-6462-4bb4-9a7e-2be512fa51e1 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 204 len: 0 microversion: 2.1 time: 0.194270 Feb 17 03:32:11.448607 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 335/675] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:32:11 2021] DELETE /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 17 03:32:11.457865 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-48dc8248-185a-417d-9f26-fe8d6f220f52 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:11.458381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-48dc8248-185a-417d-9f26-fe8d6f220f52 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:11.467330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-48dc8248-185a-417d-9f26-fe8d6f220f52 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:11.467842 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-48dc8248-185a-417d-9f26-fe8d6f220f52 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:11.468695 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-48dc8248-185a-417d-9f26-fe8d6f220f52 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:11.469386 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-48dc8248-185a-417d-9f26-fe8d6f220f52 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:11.481295 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-1ecc68f1-8226-4daa-ad21-61d7c70dfc59 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Flavor limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:32:11.481784 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-1ecc68f1-8226-4daa-ad21-61d7c70dfc59 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Image limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:32:11.482343 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-1ecc68f1-8226-4daa-ad21-61d7c70dfc59 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Flavor pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:32:11.482938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-1ecc68f1-8226-4daa-ad21-61d7c70dfc59 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Image pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:32:11.483409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-1ecc68f1-8226-4daa-ad21-61d7c70dfc59 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:32:11.493166 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1ecc68f1-8226-4daa-ad21-61d7c70dfc59 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:11.494203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1ecc68f1-8226-4daa-ad21-61d7c70dfc59 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:11.495136 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1ecc68f1-8226-4daa-ad21-61d7c70dfc59 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:11.495635 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1ecc68f1-8226-4daa-ad21-61d7c70dfc59 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:11.514869 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-1ecc68f1-8226-4daa-ad21-61d7c70dfc59 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Getting quotas for project 09f977ccc1e54aa6bfffd127c9a4be7d. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:32:11.519118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-1ecc68f1-8226-4daa-ad21-61d7c70dfc59 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Getting quotas for user 1c16fada80664e0cb2bc0031171b6c04 and project 09f977ccc1e54aa6bfffd127c9a4be7d. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:32:11.627205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1ecc68f1-8226-4daa-ad21-61d7c70dfc59 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Going to run 1 instances... {{(pid=98104) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:32:11.630186 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1ecc68f1-8226-4daa-ad21-61d7c70dfc59 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0587f459-8d6d-4266-8f32-d415c955e649',volume_size=None,volume_type=None)] {{(pid=98104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:32:11.690872 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-48dc8248-185a-417d-9f26-fe8d6f220f52 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:11.700190 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-48dc8248-185a-417d-9f26-fe8d6f220f52 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.246982 Feb 17 03:32:11.700699 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 336/676] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:11 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:11.865649 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1ecc68f1-8226-4daa-ad21-61d7c70dfc59 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 412 microversion: 2.1 time: 1.405393 Feb 17 03:32:11.866384 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 341/677] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:32:10 2021] POST /compute/v2.1/servers => generated 412 bytes in 1407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:32:11.877104 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8e10912d-545e-48a4-a18e-dbb41c4c0e23 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:11.877978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8e10912d-545e-48a4-a18e-dbb41c4c0e23 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:11.898132 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8102eb4e-c4b1-4f35-a7ae-80aac92c09df tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:11.899362 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8102eb4e-c4b1-4f35-a7ae-80aac92c09df tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:11.909803 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8102eb4e-c4b1-4f35-a7ae-80aac92c09df tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:11.909979 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8102eb4e-c4b1-4f35-a7ae-80aac92c09df tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:11.910905 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8102eb4e-c4b1-4f35-a7ae-80aac92c09df tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:11.911500 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8102eb4e-c4b1-4f35-a7ae-80aac92c09df tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:11.982510 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8e10912d-545e-48a4-a18e-dbb41c4c0e23 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:11.991047 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8e10912d-545e-48a4-a18e-dbb41c4c0e23 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1093 microversion: 2.1 time: 0.117907 Feb 17 03:32:11.991776 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 337/678] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:11 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1093 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:12.047875 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8102eb4e-c4b1-4f35-a7ae-80aac92c09df tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.153785 Feb 17 03:32:12.049061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 342/679] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:11 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:32:12.182315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5416cd0c-5b97-466d-8aae-d0e1e8a84dd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:12.184048 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5416cd0c-5b97-466d-8aae-d0e1e8a84dd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:12.192425 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5416cd0c-5b97-466d-8aae-d0e1e8a84dd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:12.192937 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5416cd0c-5b97-466d-8aae-d0e1e8a84dd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:12.193817 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5416cd0c-5b97-466d-8aae-d0e1e8a84dd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:12.194314 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5416cd0c-5b97-466d-8aae-d0e1e8a84dd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:12.331175 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5416cd0c-5b97-466d-8aae-d0e1e8a84dd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.152746 Feb 17 03:32:12.335338 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 338/680] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:12 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:12.719325 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-64253c9c-43f2-42e2-b09a-62de5b6e8434 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:12.720102 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-64253c9c-43f2-42e2-b09a-62de5b6e8434 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:12.729134 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-64253c9c-43f2-42e2-b09a-62de5b6e8434 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:12.729646 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-64253c9c-43f2-42e2-b09a-62de5b6e8434 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:12.730480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-64253c9c-43f2-42e2-b09a-62de5b6e8434 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:12.730975 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-64253c9c-43f2-42e2-b09a-62de5b6e8434 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:12.968338 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-64253c9c-43f2-42e2-b09a-62de5b6e8434 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:12.995557 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-64253c9c-43f2-42e2-b09a-62de5b6e8434 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.280684 Feb 17 03:32:12.996162 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 343/681] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:12 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:13.012532 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-36472aea-8588-4f65-937c-67d4adc8f45c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:13.013409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-36472aea-8588-4f65-937c-67d4adc8f45c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:13.021975 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-36472aea-8588-4f65-937c-67d4adc8f45c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:13.022526 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-36472aea-8588-4f65-937c-67d4adc8f45c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:13.023372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-36472aea-8588-4f65-937c-67d4adc8f45c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:13.023873 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-36472aea-8588-4f65-937c-67d4adc8f45c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:13.060931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4abf81cb-f189-45d7-8f4c-aa0c5b934160 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:13.062344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4abf81cb-f189-45d7-8f4c-aa0c5b934160 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:13.070487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4abf81cb-f189-45d7-8f4c-aa0c5b934160 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:13.070986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4abf81cb-f189-45d7-8f4c-aa0c5b934160 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:13.072498 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4abf81cb-f189-45d7-8f4c-aa0c5b934160 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:13.072984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4abf81cb-f189-45d7-8f4c-aa0c5b934160 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:13.160599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-36472aea-8588-4f65-937c-67d4adc8f45c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:13.170038 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-36472aea-8588-4f65-937c-67d4adc8f45c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1199 microversion: 2.1 time: 0.163856 Feb 17 03:32:13.170610 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 339/682] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:13 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1199 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:13.220391 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4abf81cb-f189-45d7-8f4c-aa0c5b934160 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.163227 Feb 17 03:32:13.221098 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 344/683] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:13 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:32:13.343478 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-96272e41-c8ae-4ee6-ad0d-db867bc457c1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:13.344710 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-96272e41-c8ae-4ee6-ad0d-db867bc457c1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:13.355344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-96272e41-c8ae-4ee6-ad0d-db867bc457c1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:13.355985 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-96272e41-c8ae-4ee6-ad0d-db867bc457c1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:13.356831 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-96272e41-c8ae-4ee6-ad0d-db867bc457c1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:13.357382 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-96272e41-c8ae-4ee6-ad0d-db867bc457c1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:13.492467 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-96272e41-c8ae-4ee6-ad0d-db867bc457c1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.152766 Feb 17 03:32:13.493271 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 340/684] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:13 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:14.014252 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a1eff26a-7d72-4879-b133-6eec22f04a02 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:14.015147 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a1eff26a-7d72-4879-b133-6eec22f04a02 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:14.023946 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1eff26a-7d72-4879-b133-6eec22f04a02 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:14.025098 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1eff26a-7d72-4879-b133-6eec22f04a02 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:14.026072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1eff26a-7d72-4879-b133-6eec22f04a02 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:14.026680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1eff26a-7d72-4879-b133-6eec22f04a02 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:14.188609 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-82b0cac0-4526-44bb-b776-73648de2793d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:14.189428 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-82b0cac0-4526-44bb-b776-73648de2793d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:14.198724 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82b0cac0-4526-44bb-b776-73648de2793d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:14.199233 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82b0cac0-4526-44bb-b776-73648de2793d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:14.200066 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82b0cac0-4526-44bb-b776-73648de2793d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:14.200553 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82b0cac0-4526-44bb-b776-73648de2793d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:14.425287 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-82b0cac0-4526-44bb-b776-73648de2793d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:14.434187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-82b0cac0-4526-44bb-b776-73648de2793d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1283 microversion: 2.1 time: 0.250022 Feb 17 03:32:14.434775 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 341/685] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:14 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1283 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:14.439676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-97b937b1-579a-48f1-a6a9-098b8470a501 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:14.440969 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-97b937b1-579a-48f1-a6a9-098b8470a501 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:14.446906 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a1eff26a-7d72-4879-b133-6eec22f04a02 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:14.449947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-97b937b1-579a-48f1-a6a9-098b8470a501 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:14.450469 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-97b937b1-579a-48f1-a6a9-098b8470a501 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:14.451344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-97b937b1-579a-48f1-a6a9-098b8470a501 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:14.452228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-97b937b1-579a-48f1-a6a9-098b8470a501 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:14.467261 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a1eff26a-7d72-4879-b133-6eec22f04a02 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.457456 Feb 17 03:32:14.468527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 345/686] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:14 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:14.505007 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cad630db-aaea-4e6d-b2c2-8b1050f89c5e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:14.506663 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cad630db-aaea-4e6d-b2c2-8b1050f89c5e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:14.516700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cad630db-aaea-4e6d-b2c2-8b1050f89c5e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:14.517604 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cad630db-aaea-4e6d-b2c2-8b1050f89c5e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:14.518887 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cad630db-aaea-4e6d-b2c2-8b1050f89c5e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:14.520257 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cad630db-aaea-4e6d-b2c2-8b1050f89c5e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:14.595209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-97b937b1-579a-48f1-a6a9-098b8470a501 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.158855 Feb 17 03:32:14.596146 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 342/687] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:14 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:32:14.676779 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cad630db-aaea-4e6d-b2c2-8b1050f89c5e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.175693 Feb 17 03:32:14.677613 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 346/688] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:14 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:15.453072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-86c6482e-2915-4474-ab74-c96a3f192cb4 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:15.454449 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-86c6482e-2915-4474-ab74-c96a3f192cb4 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:15.467882 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-86c6482e-2915-4474-ab74-c96a3f192cb4 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:15.468664 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-86c6482e-2915-4474-ab74-c96a3f192cb4 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:15.469723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-86c6482e-2915-4474-ab74-c96a3f192cb4 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:15.470376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-86c6482e-2915-4474-ab74-c96a3f192cb4 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:15.486707 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c5c0b32b-8ac8-4e10-9506-7a3134fc5dfa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:15.487748 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c5c0b32b-8ac8-4e10-9506-7a3134fc5dfa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:15.496987 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c5c0b32b-8ac8-4e10-9506-7a3134fc5dfa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:15.497528 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c5c0b32b-8ac8-4e10-9506-7a3134fc5dfa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:15.498392 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c5c0b32b-8ac8-4e10-9506-7a3134fc5dfa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:15.498895 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c5c0b32b-8ac8-4e10-9506-7a3134fc5dfa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:15.714502 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-86c6482e-2915-4474-ab74-c96a3f192cb4 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:15.724123 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-86c6482e-2915-4474-ab74-c96a3f192cb4 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1283 microversion: 2.1 time: 0.275799 Feb 17 03:32:15.725057 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 343/689] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:15 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1283 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:15.730037 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1bbead41-ccc4-4020-a7ce-33ef7fb52fdb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:15.731160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1bbead41-ccc4-4020-a7ce-33ef7fb52fdb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:15.739294 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1bbead41-ccc4-4020-a7ce-33ef7fb52fdb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:15.739873 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1bbead41-ccc4-4020-a7ce-33ef7fb52fdb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:15.740780 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1bbead41-ccc4-4020-a7ce-33ef7fb52fdb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:15.741317 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1bbead41-ccc4-4020-a7ce-33ef7fb52fdb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:15.882401 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1bbead41-ccc4-4020-a7ce-33ef7fb52fdb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.155803 Feb 17 03:32:15.887485 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 344/690] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:15 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:32:15.891942 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7762a963-282f-4638-99cd-55f78c825ad2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:15.893132 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7762a963-282f-4638-99cd-55f78c825ad2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:15.902522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7762a963-282f-4638-99cd-55f78c825ad2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:15.903030 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7762a963-282f-4638-99cd-55f78c825ad2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:15.903906 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7762a963-282f-4638-99cd-55f78c825ad2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:15.904398 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7762a963-282f-4638-99cd-55f78c825ad2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:16.070767 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7762a963-282f-4638-99cd-55f78c825ad2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.185154 Feb 17 03:32:16.076214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 345/691] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:15 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:16.264380 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-3fc3e35b-0889-4700-af14-1b6c0bf6e36b req-5491ae61-8ae0-4c9e-8983-e2bceecc3112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce920548-efb2-455b-a260-d9b321d73cd9", "tag": "ce570470-08b9-4b72-be9b-4b61e88ce552"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:16.266141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:16.266141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:32:16.287124 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-3fc3e35b-0889-4700-af14-1b6c0bf6e36b req-5491ae61-8ae0-4c9e-8983-e2bceecc3112 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:16.287639 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-3fc3e35b-0889-4700-af14-1b6c0bf6e36b req-5491ae61-8ae0-4c9e-8983-e2bceecc3112 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:16.310612 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-3fc3e35b-0889-4700-af14-1b6c0bf6e36b req-5491ae61-8ae0-4c9e-8983-e2bceecc3112 service nova] Creating event network-changed:ce570470-08b9-4b72-be9b-4b61e88ce552 for instance ce920548-efb2-455b-a260-d9b321d73cd9 on hv-cinder-75994 Feb 17 03:32:16.318844 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-3fc3e35b-0889-4700-af14-1b6c0bf6e36b req-5491ae61-8ae0-4c9e-8983-e2bceecc3112 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058816 Feb 17 03:32:16.319712 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 346/692] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:32:16.331752 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c5c0b32b-8ac8-4e10-9506-7a3134fc5dfa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:16.341003 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c5c0b32b-8ac8-4e10-9506-7a3134fc5dfa tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.858942 Feb 17 03:32:16.341821 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 347/693] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:15 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:16.743115 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ffe0596c-b7da-4d45-9ae1-4f61048f0af1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:16.744092 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ffe0596c-b7da-4d45-9ae1-4f61048f0af1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:16.752195 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ffe0596c-b7da-4d45-9ae1-4f61048f0af1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:16.752694 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ffe0596c-b7da-4d45-9ae1-4f61048f0af1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:16.753583 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ffe0596c-b7da-4d45-9ae1-4f61048f0af1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:16.754071 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ffe0596c-b7da-4d45-9ae1-4f61048f0af1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:16.895643 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1542fc4a-4d0e-4fc1-b96b-bb2003d780af tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:16.897289 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1542fc4a-4d0e-4fc1-b96b-bb2003d780af tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:16.907563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1542fc4a-4d0e-4fc1-b96b-bb2003d780af tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:16.908400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1542fc4a-4d0e-4fc1-b96b-bb2003d780af tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:16.909631 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1542fc4a-4d0e-4fc1-b96b-bb2003d780af tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:16.910672 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1542fc4a-4d0e-4fc1-b96b-bb2003d780af tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:16.975523 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ffe0596c-b7da-4d45-9ae1-4f61048f0af1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:16.984614 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ffe0596c-b7da-4d45-9ae1-4f61048f0af1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1283 microversion: 2.1 time: 0.246028 Feb 17 03:32:16.985354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 347/694] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:16 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1283 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:17.066872 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1542fc4a-4d0e-4fc1-b96b-bb2003d780af tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.175028 Feb 17 03:32:17.071212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 348/695] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:16 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:32:17.084321 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5eb1fe9c-04f8-4b6b-9764-f0379a763722 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:17.085371 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5eb1fe9c-04f8-4b6b-9764-f0379a763722 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:17.093278 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5eb1fe9c-04f8-4b6b-9764-f0379a763722 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:17.094012 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5eb1fe9c-04f8-4b6b-9764-f0379a763722 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:17.094848 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5eb1fe9c-04f8-4b6b-9764-f0379a763722 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:17.095332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5eb1fe9c-04f8-4b6b-9764-f0379a763722 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:17.252881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5eb1fe9c-04f8-4b6b-9764-f0379a763722 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.172470 Feb 17 03:32:17.257205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 348/696] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:17 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:32:17.360284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ccf09515-3eda-445e-a3fd-2193125d2a07 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:17.360805 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ccf09515-3eda-445e-a3fd-2193125d2a07 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:17.370393 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ccf09515-3eda-445e-a3fd-2193125d2a07 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:17.370817 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ccf09515-3eda-445e-a3fd-2193125d2a07 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:17.371713 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ccf09515-3eda-445e-a3fd-2193125d2a07 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:17.372326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ccf09515-3eda-445e-a3fd-2193125d2a07 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:17.700795 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ccf09515-3eda-445e-a3fd-2193125d2a07 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:17.709744 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ccf09515-3eda-445e-a3fd-2193125d2a07 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.354172 Feb 17 03:32:17.710342 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 349/697] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:17 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:18.003994 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-20ecd098-c86d-4c71-a707-f738f29680fd tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:18.004759 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-20ecd098-c86d-4c71-a707-f738f29680fd tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:18.013810 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-20ecd098-c86d-4c71-a707-f738f29680fd tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:18.014317 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-20ecd098-c86d-4c71-a707-f738f29680fd tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:18.015148 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-20ecd098-c86d-4c71-a707-f738f29680fd tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:18.015631 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-20ecd098-c86d-4c71-a707-f738f29680fd tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:18.079169 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-26ec64de-67a2-4d36-ac2f-275b8ca2bb3a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:18.080824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-26ec64de-67a2-4d36-ac2f-275b8ca2bb3a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:18.089537 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-26ec64de-67a2-4d36-ac2f-275b8ca2bb3a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:18.090390 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-26ec64de-67a2-4d36-ac2f-275b8ca2bb3a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:18.091049 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-26ec64de-67a2-4d36-ac2f-275b8ca2bb3a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:18.091548 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-26ec64de-67a2-4d36-ac2f-275b8ca2bb3a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:18.277811 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-20ecd098-c86d-4c71-a707-f738f29680fd tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:18.287002 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-20ecd098-c86d-4c71-a707-f738f29680fd tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1283 microversion: 2.1 time: 0.287460 Feb 17 03:32:18.287730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 349/698] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:17 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1283 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:18.292485 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-26ec64de-67a2-4d36-ac2f-275b8ca2bb3a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.217360 Feb 17 03:32:18.293187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9f4b7b38-3d1d-42c7-a89c-ebf0fc97300e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:18.293711 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 350/699] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:18 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:32:18.294374 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9f4b7b38-3d1d-42c7-a89c-ebf0fc97300e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:18.302648 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9f4b7b38-3d1d-42c7-a89c-ebf0fc97300e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:18.303269 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9f4b7b38-3d1d-42c7-a89c-ebf0fc97300e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:18.304163 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9f4b7b38-3d1d-42c7-a89c-ebf0fc97300e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:18.304730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9f4b7b38-3d1d-42c7-a89c-ebf0fc97300e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:18.501286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9f4b7b38-3d1d-42c7-a89c-ebf0fc97300e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 28603 microversion: 2.20 time: 0.211764 Feb 17 03:32:18.506856 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 350/700] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:18 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 28603 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:18.729187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-835b130a-8cf5-4522-9e8c-4611caad46ce tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:18.729917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-835b130a-8cf5-4522-9e8c-4611caad46ce tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:18.738526 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-835b130a-8cf5-4522-9e8c-4611caad46ce tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:18.739008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-835b130a-8cf5-4522-9e8c-4611caad46ce tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:18.739901 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-835b130a-8cf5-4522-9e8c-4611caad46ce tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:18.740391 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-835b130a-8cf5-4522-9e8c-4611caad46ce tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:18.950739 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-835b130a-8cf5-4522-9e8c-4611caad46ce tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:18.959489 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-835b130a-8cf5-4522-9e8c-4611caad46ce tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1520 microversion: 2.1 time: 0.235254 Feb 17 03:32:18.960100 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 351/701] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:18 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:19.196000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-a14b0afa-fcb5-4e12-be4f-f10a36c4b7d5 req-0d1a24ef-e538-4b05-8a3e-69be0d03a363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d58358-22a0-4562-9370-9574a29ec572", "name": "network-vif-unplugged", "status": "completed", "tag": "d5ada634-5cb7-40f0-b70e-0091b83e2ef6"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:19.199455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:19.199455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:32:19.209411 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-a14b0afa-fcb5-4e12-be4f-f10a36c4b7d5 req-0d1a24ef-e538-4b05-8a3e-69be0d03a363 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:19.209909 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-a14b0afa-fcb5-4e12-be4f-f10a36c4b7d5 req-0d1a24ef-e538-4b05-8a3e-69be0d03a363 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:19.227275 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-a14b0afa-fcb5-4e12-be4f-f10a36c4b7d5 req-0d1a24ef-e538-4b05-8a3e-69be0d03a363 service nova] Creating event network-vif-unplugged:d5ada634-5cb7-40f0-b70e-0091b83e2ef6 for instance b4d58358-22a0-4562-9370-9574a29ec572 on hv-cinder-75994 Feb 17 03:32:19.232272 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-a14b0afa-fcb5-4e12-be4f-f10a36c4b7d5 req-0d1a24ef-e538-4b05-8a3e-69be0d03a363 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041259 Feb 17 03:32:19.233096 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 351/702] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:19 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:32:19.304772 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-24a89b5e-7de1-4153-aa29-13c91976631e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:19.306412 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-24a89b5e-7de1-4153-aa29-13c91976631e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:19.314613 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-24a89b5e-7de1-4153-aa29-13c91976631e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:19.315123 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-24a89b5e-7de1-4153-aa29-13c91976631e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:19.315961 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-24a89b5e-7de1-4153-aa29-13c91976631e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:19.316452 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-24a89b5e-7de1-4153-aa29-13c91976631e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:19.316719 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7768c324-b741-45e2-9b26-3bc7ceef9f94 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:19.317907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7768c324-b741-45e2-9b26-3bc7ceef9f94 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:19.326945 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7768c324-b741-45e2-9b26-3bc7ceef9f94 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:19.327463 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7768c324-b741-45e2-9b26-3bc7ceef9f94 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:19.328318 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7768c324-b741-45e2-9b26-3bc7ceef9f94 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:19.328815 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7768c324-b741-45e2-9b26-3bc7ceef9f94 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:19.574541 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7768c324-b741-45e2-9b26-3bc7ceef9f94 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 28570 microversion: 2.1 time: 0.261502 Feb 17 03:32:19.575995 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 352/703] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:19 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 28570 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:32:19.585330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-53bd394f-ba71-4bc0-83c3-9586a0fd84b3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:19.587141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-53bd394f-ba71-4bc0-83c3-9586a0fd84b3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:19.603555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-53bd394f-ba71-4bc0-83c3-9586a0fd84b3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:19.604410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-53bd394f-ba71-4bc0-83c3-9586a0fd84b3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:19.605886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-53bd394f-ba71-4bc0-83c3-9586a0fd84b3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:19.606392 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-53bd394f-ba71-4bc0-83c3-9586a0fd84b3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:19.791822 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-53bd394f-ba71-4bc0-83c3-9586a0fd84b3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 30063 microversion: 2.20 time: 0.213862 Feb 17 03:32:19.792734 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 353/704] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:19 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 30063 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:19.979115 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c4045119-0c60-4933-af7d-5ae04fc5f03a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:19.979886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c4045119-0c60-4933-af7d-5ae04fc5f03a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:19.988426 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c4045119-0c60-4933-af7d-5ae04fc5f03a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:19.988942 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c4045119-0c60-4933-af7d-5ae04fc5f03a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:19.989806 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c4045119-0c60-4933-af7d-5ae04fc5f03a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:19.990296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c4045119-0c60-4933-af7d-5ae04fc5f03a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:20.060899 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-24a89b5e-7de1-4153-aa29-13c91976631e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:20.070544 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-24a89b5e-7de1-4153-aa29-13c91976631e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1283 microversion: 2.1 time: 0.769522 Feb 17 03:32:20.077731 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 352/705] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:19 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1283 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:20.120855 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c4045119-0c60-4933-af7d-5ae04fc5f03a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:20.129956 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c4045119-0c60-4933-af7d-5ae04fc5f03a tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1478 microversion: 2.1 time: 0.155866 Feb 17 03:32:20.130719 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 354/706] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:19 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1478 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:20.302384 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-46ab689a-0126-40ec-8190-91e5dcab210d req-3f1f40d7-ae81-4e74-bcb4-64368a63a39f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d58358-22a0-4562-9370-9574a29ec572", "name": "network-vif-deleted", "tag": "d5ada634-5cb7-40f0-b70e-0091b83e2ef6"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:20.304231 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:20.304231 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:32:20.313008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-46ab689a-0126-40ec-8190-91e5dcab210d req-3f1f40d7-ae81-4e74-bcb4-64368a63a39f service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:20.313568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-46ab689a-0126-40ec-8190-91e5dcab210d req-3f1f40d7-ae81-4e74-bcb4-64368a63a39f service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:20.331818 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-46ab689a-0126-40ec-8190-91e5dcab210d req-3f1f40d7-ae81-4e74-bcb4-64368a63a39f service nova] Creating event network-vif-deleted:d5ada634-5cb7-40f0-b70e-0091b83e2ef6 for instance b4d58358-22a0-4562-9370-9574a29ec572 on hv-cinder-75994 Feb 17 03:32:20.336604 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-46ab689a-0126-40ec-8190-91e5dcab210d req-3f1f40d7-ae81-4e74-bcb4-64368a63a39f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038237 Feb 17 03:32:20.337847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 353/707] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:20.587451 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-be9fd50f-4000-4493-97e5-7139d92d648f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:20.588519 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-be9fd50f-4000-4493-97e5-7139d92d648f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:20.596332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be9fd50f-4000-4493-97e5-7139d92d648f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:20.596828 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be9fd50f-4000-4493-97e5-7139d92d648f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:20.597675 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be9fd50f-4000-4493-97e5-7139d92d648f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:20.598160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be9fd50f-4000-4493-97e5-7139d92d648f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:20.804807 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3cb8f840-ba16-41d4-b743-f3167ef9c11a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:20.806478 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3cb8f840-ba16-41d4-b743-f3167ef9c11a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:20.814382 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3cb8f840-ba16-41d4-b743-f3167ef9c11a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:20.814887 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3cb8f840-ba16-41d4-b743-f3167ef9c11a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:20.820351 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3cb8f840-ba16-41d4-b743-f3167ef9c11a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:20.820351 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3cb8f840-ba16-41d4-b743-f3167ef9c11a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:25.021931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-be9fd50f-4000-4493-97e5-7139d92d648f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 33544 microversion: 2.1 time: 4.438199 Feb 17 03:32:25.022911 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 355/708] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:20 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 33544 bytes in 4440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:32:25.028658 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ab0b4433-06f9-49fe-9ec8-808aecb962a9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:25.029466 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ab0b4433-06f9-49fe-9ec8-808aecb962a9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:25.037815 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ab0b4433-06f9-49fe-9ec8-808aecb962a9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:25.038319 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ab0b4433-06f9-49fe-9ec8-808aecb962a9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:25.039137 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ab0b4433-06f9-49fe-9ec8-808aecb962a9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:25.039624 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ab0b4433-06f9-49fe-9ec8-808aecb962a9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:25.050438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3cb8f840-ba16-41d4-b743-f3167ef9c11a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 35158 microversion: 2.20 time: 4.250010 Feb 17 03:32:25.051396 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 354/709] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:20 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 35158 bytes in 4252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:32:25.056513 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bb90492d-68e1-46b6-8774-fd11ea1d5c83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:25.057315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bb90492d-68e1-46b6-8774-fd11ea1d5c83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:25.065809 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb90492d-68e1-46b6-8774-fd11ea1d5c83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:25.066320 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb90492d-68e1-46b6-8774-fd11ea1d5c83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:25.067186 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb90492d-68e1-46b6-8774-fd11ea1d5c83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:25.067671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb90492d-68e1-46b6-8774-fd11ea1d5c83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:25.140461 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb90492d-68e1-46b6-8774-fd11ea1d5c83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:25.140971 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb90492d-68e1-46b6-8774-fd11ea1d5c83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:25.141506 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-bb90492d-68e1-46b6-8774-fd11ea1d5c83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lazy-loading 'fault' on Instance uuid b4d58358-22a0-4562-9370-9574a29ec572 {{(pid=98104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:32:25.221203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bb90492d-68e1-46b6-8774-fd11ea1d5c83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3044252e900455594e84c1bac2a43cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8da7eb55c2cb47dc99275360edd183e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:25.230689 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bb90492d-68e1-46b6-8774-fd11ea1d5c83 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 200 len: 1311 microversion: 2.1 time: 0.178344 Feb 17 03:32:25.231410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 355/710] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:25 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 1311 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:25.248548 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ab0b4433-06f9-49fe-9ec8-808aecb962a9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:25.257408 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ab0b4433-06f9-49fe-9ec8-808aecb962a9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1283 microversion: 2.1 time: 0.233275 Feb 17 03:32:25.257993 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 356/711] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:25 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1283 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:26.034992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2cca0527-e48b-47d1-9952-f008a89ab23b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:26.036045 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2cca0527-e48b-47d1-9952-f008a89ab23b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:26.044300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2cca0527-e48b-47d1-9952-f008a89ab23b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:26.044805 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2cca0527-e48b-47d1-9952-f008a89ab23b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:26.045675 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2cca0527-e48b-47d1-9952-f008a89ab23b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:26.046168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2cca0527-e48b-47d1-9952-f008a89ab23b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:26.063608 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-09798a75-f257-46db-a345-874ec68f66a4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:26.064981 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-09798a75-f257-46db-a345-874ec68f66a4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:26.074997 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09798a75-f257-46db-a345-874ec68f66a4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:26.075728 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09798a75-f257-46db-a345-874ec68f66a4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:26.076573 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09798a75-f257-46db-a345-874ec68f66a4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:26.077084 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09798a75-f257-46db-a345-874ec68f66a4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:26.234524 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2cca0527-e48b-47d1-9952-f008a89ab23b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 34159 microversion: 2.1 time: 0.203311 Feb 17 03:32:26.235154 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 356/712] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:26 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 34159 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:32:26.248996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4dfd593d-42ec-434d-adab-1d7072b90698 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:26.249697 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4dfd593d-42ec-434d-adab-1d7072b90698 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] [instance: b4d58358-22a0-4562-9370-9574a29ec572] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:26.258577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4dfd593d-42ec-434d-adab-1d7072b90698 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:26.258895 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-09798a75-f257-46db-a345-874ec68f66a4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 36617 microversion: 2.20 time: 0.199021 Feb 17 03:32:26.259101 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4dfd593d-42ec-434d-adab-1d7072b90698 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:26.259807 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 357/713] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:26 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 36617 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:32:26.259952 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4dfd593d-42ec-434d-adab-1d7072b90698 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:26.260416 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4dfd593d-42ec-434d-adab-1d7072b90698 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:26.274562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6bea42ce-11e3-4625-9a41-d111b307fd13 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:26.275325 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6bea42ce-11e3-4625-9a41-d111b307fd13 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:26.284017 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6bea42ce-11e3-4625-9a41-d111b307fd13 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:26.284520 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6bea42ce-11e3-4625-9a41-d111b307fd13 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:26.285372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6bea42ce-11e3-4625-9a41-d111b307fd13 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:26.285874 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6bea42ce-11e3-4625-9a41-d111b307fd13 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:26.314350 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-4dfd593d-42ec-434d-adab-1d7072b90698 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] HTTP exception thrown: Instance b4d58358-22a0-4562-9370-9574a29ec572 could not be found. Feb 17 03:32:26.315023 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4dfd593d-42ec-434d-adab-1d7072b90698 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] Returning 404 to user: Instance b4d58358-22a0-4562-9370-9574a29ec572 could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:32:26.315931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4dfd593d-42ec-434d-adab-1d7072b90698 tempest-ServerRescueNegativeTestJSON-571512782 tempest-ServerRescueNegativeTestJSON-571512782-project] 10.222.0.57 "GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572" status: 404 len: 111 microversion: 2.1 time: 0.071535 Feb 17 03:32:26.316756 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 357/714] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:26 2021] GET /compute/v2.1/servers/b4d58358-22a0-4562-9370-9574a29ec572 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 03:32:26.716550 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6bea42ce-11e3-4625-9a41-d111b307fd13 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:26.726483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6bea42ce-11e3-4625-9a41-d111b307fd13 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1283 microversion: 2.1 time: 0.456072 Feb 17 03:32:26.733913 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 358/715] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:26 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1283 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:27.247022 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0aa5215e-76f3-4f22-b21e-977ac090f9dc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:27.248195 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0aa5215e-76f3-4f22-b21e-977ac090f9dc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:27.256529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0aa5215e-76f3-4f22-b21e-977ac090f9dc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:27.257146 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0aa5215e-76f3-4f22-b21e-977ac090f9dc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:27.257991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0aa5215e-76f3-4f22-b21e-977ac090f9dc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:27.258483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0aa5215e-76f3-4f22-b21e-977ac090f9dc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:27.271215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d181e9ac-c45c-465c-a731-014173f91965 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:27.272509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d181e9ac-c45c-465c-a731-014173f91965 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:27.280959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d181e9ac-c45c-465c-a731-014173f91965 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:27.281534 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d181e9ac-c45c-465c-a731-014173f91965 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:27.282393 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d181e9ac-c45c-465c-a731-014173f91965 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:27.282888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d181e9ac-c45c-465c-a731-014173f91965 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:27.479059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d181e9ac-c45c-465c-a731-014173f91965 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 37667 microversion: 2.20 time: 0.211528 Feb 17 03:32:27.480070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 359/716] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:27 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 37667 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:32:27.580492 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0aa5215e-76f3-4f22-b21e-977ac090f9dc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 35228 microversion: 2.1 time: 0.337724 Feb 17 03:32:27.581278 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 358/717] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:27 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 35228 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:32:27.747551 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-af8bc6c6-8d71-45c7-916c-cfb4c5cc9407 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:27.748253 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-af8bc6c6-8d71-45c7-916c-cfb4c5cc9407 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:27.756712 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-af8bc6c6-8d71-45c7-916c-cfb4c5cc9407 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:27.757250 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-af8bc6c6-8d71-45c7-916c-cfb4c5cc9407 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:27.758088 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-af8bc6c6-8d71-45c7-916c-cfb4c5cc9407 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:27.758572 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-af8bc6c6-8d71-45c7-916c-cfb4c5cc9407 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:27.977012 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9e943376-3ec9-4590-8ab9-9839d8dfa1e3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:27.978473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9e943376-3ec9-4590-8ab9-9839d8dfa1e3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:27.987153 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9e943376-3ec9-4590-8ab9-9839d8dfa1e3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:27.987884 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9e943376-3ec9-4590-8ab9-9839d8dfa1e3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:27.988825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9e943376-3ec9-4590-8ab9-9839d8dfa1e3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:27.989415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9e943376-3ec9-4590-8ab9-9839d8dfa1e3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:28.054323 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9e943376-3ec9-4590-8ab9-9839d8dfa1e3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Going to try to terminate instance {{(pid=98104) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:32:28.173105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9e943376-3ec9-4590-8ab9-9839d8dfa1e3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 204 len: 0 microversion: 2.1 time: 0.200543 Feb 17 03:32:28.173962 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 359/718] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:32:27 2021] DELETE /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:32:28.182763 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-62076d58-c275-4d06-b585-fdee4fd6a73a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:28.183530 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-62076d58-c275-4d06-b585-fdee4fd6a73a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:28.191206 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-62076d58-c275-4d06-b585-fdee4fd6a73a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:28.191719 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-62076d58-c275-4d06-b585-fdee4fd6a73a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:28.192560 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-62076d58-c275-4d06-b585-fdee4fd6a73a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:28.193064 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-62076d58-c275-4d06-b585-fdee4fd6a73a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:28.258984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-af8bc6c6-8d71-45c7-916c-cfb4c5cc9407 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:28.268018 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-af8bc6c6-8d71-45c7-916c-cfb4c5cc9407 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1283 microversion: 2.1 time: 0.525705 Feb 17 03:32:28.268841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 360/719] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:27 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1283 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:28.411439 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-62076d58-c275-4d06-b585-fdee4fd6a73a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:28.420502 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-62076d58-c275-4d06-b585-fdee4fd6a73a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1512 microversion: 2.1 time: 0.242280 Feb 17 03:32:28.421108 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 360/720] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:28 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1512 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:28.491624 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e1f4748a-f580-40a4-8ce3-79e76e9f41c9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:28.492663 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e1f4748a-f580-40a4-8ce3-79e76e9f41c9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:28.500371 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e1f4748a-f580-40a4-8ce3-79e76e9f41c9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:28.500878 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e1f4748a-f580-40a4-8ce3-79e76e9f41c9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:28.501741 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e1f4748a-f580-40a4-8ce3-79e76e9f41c9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:28.502220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e1f4748a-f580-40a4-8ce3-79e76e9f41c9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:28.593854 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cba28db2-1b76-47cd-bbaf-ec952316761e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:28.594986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cba28db2-1b76-47cd-bbaf-ec952316761e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:28.603162 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cba28db2-1b76-47cd-bbaf-ec952316761e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:28.603673 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cba28db2-1b76-47cd-bbaf-ec952316761e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:28.604514 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cba28db2-1b76-47cd-bbaf-ec952316761e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:28.605007 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cba28db2-1b76-47cd-bbaf-ec952316761e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:31.583188 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cba28db2-1b76-47cd-bbaf-ec952316761e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 38095 microversion: 2.1 time: 2.992916 Feb 17 03:32:31.584302 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 361/721] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:28 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 38095 bytes in 2995 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:32:31.590336 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-82c2a2d6-5d09-4e88-a2d3-2d000dcfeacf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:31.591105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-82c2a2d6-5d09-4e88-a2d3-2d000dcfeacf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:31.599738 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82c2a2d6-5d09-4e88-a2d3-2d000dcfeacf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:31.600260 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82c2a2d6-5d09-4e88-a2d3-2d000dcfeacf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:31.601126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82c2a2d6-5d09-4e88-a2d3-2d000dcfeacf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:31.601625 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82c2a2d6-5d09-4e88-a2d3-2d000dcfeacf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:31.633097 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e1f4748a-f580-40a4-8ce3-79e76e9f41c9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 38144 microversion: 2.20 time: 3.145284 Feb 17 03:32:31.634449 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 361/722] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:28 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 38144 bytes in 3148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:31.644743 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a24a24eb-f604-4a2a-b354-7abad3bf135f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:31.645759 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a24a24eb-f604-4a2a-b354-7abad3bf135f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:31.658666 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a24a24eb-f604-4a2a-b354-7abad3bf135f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:31.659393 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a24a24eb-f604-4a2a-b354-7abad3bf135f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:31.660433 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a24a24eb-f604-4a2a-b354-7abad3bf135f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:31.661721 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a24a24eb-f604-4a2a-b354-7abad3bf135f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:31.882655 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a24a24eb-f604-4a2a-b354-7abad3bf135f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:31.892807 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a24a24eb-f604-4a2a-b354-7abad3bf135f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1512 microversion: 2.1 time: 0.256639 Feb 17 03:32:31.893657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 362/723] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:31 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1512 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:31.936327 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-82c2a2d6-5d09-4e88-a2d3-2d000dcfeacf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:31.945634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-82c2a2d6-5d09-4e88-a2d3-2d000dcfeacf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1283 microversion: 2.1 time: 0.359946 Feb 17 03:32:31.946250 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 362/724] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:31 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1283 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:32.596675 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e15f0141-c486-4360-a7d1-a25b21b3076e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:32.597788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e15f0141-c486-4360-a7d1-a25b21b3076e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:32.605619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e15f0141-c486-4360-a7d1-a25b21b3076e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:32.606118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e15f0141-c486-4360-a7d1-a25b21b3076e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:32.606951 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e15f0141-c486-4360-a7d1-a25b21b3076e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:32.607435 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e15f0141-c486-4360-a7d1-a25b21b3076e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:32.647760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2a50a77e-551b-4671-8cf2-c9f64832e88d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:32.648818 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2a50a77e-551b-4671-8cf2-c9f64832e88d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:32.667881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2a50a77e-551b-4671-8cf2-c9f64832e88d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:32.668605 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2a50a77e-551b-4671-8cf2-c9f64832e88d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:32.669667 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2a50a77e-551b-4671-8cf2-c9f64832e88d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:32.670320 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2a50a77e-551b-4671-8cf2-c9f64832e88d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:32.787527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e15f0141-c486-4360-a7d1-a25b21b3076e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 38095 microversion: 2.1 time: 0.194798 Feb 17 03:32:32.788663 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 363/725] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:32 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 38095 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:32:32.895265 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2a50a77e-551b-4671-8cf2-c9f64832e88d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 38144 microversion: 2.20 time: 0.251518 Feb 17 03:32:32.900376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 363/726] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:32 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 38144 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:32.912050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-567edab9-6b6f-4fe3-b89a-079583eb502a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:32.912782 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-567edab9-6b6f-4fe3-b89a-079583eb502a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:32.922631 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-567edab9-6b6f-4fe3-b89a-079583eb502a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:32.923089 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-567edab9-6b6f-4fe3-b89a-079583eb502a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:32.923946 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-567edab9-6b6f-4fe3-b89a-079583eb502a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:32.924445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-567edab9-6b6f-4fe3-b89a-079583eb502a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:32.966450 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-71883462-d4f7-4e2b-a7be-f85b3e2698e1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:32.968028 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-71883462-d4f7-4e2b-a7be-f85b3e2698e1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:32.982989 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-71883462-d4f7-4e2b-a7be-f85b3e2698e1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:32.983758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-71883462-d4f7-4e2b-a7be-f85b3e2698e1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:32.985408 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-71883462-d4f7-4e2b-a7be-f85b3e2698e1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:32.986086 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-71883462-d4f7-4e2b-a7be-f85b3e2698e1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:33.210460 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-71883462-d4f7-4e2b-a7be-f85b3e2698e1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:33.225900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-71883462-d4f7-4e2b-a7be-f85b3e2698e1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1271 microversion: 2.1 time: 0.263806 Feb 17 03:32:33.236330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-567edab9-6b6f-4fe3-b89a-079583eb502a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:33.236797 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 364/727] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:32 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1271 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:33.246743 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-567edab9-6b6f-4fe3-b89a-079583eb502a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1512 microversion: 2.1 time: 0.339055 Feb 17 03:32:33.247623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 364/728] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:32 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1512 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:33.799947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-05c7b3a2-1cdf-4ef1-b842-632496bfb478 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:33.800986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-05c7b3a2-1cdf-4ef1-b842-632496bfb478 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:33.808675 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-05c7b3a2-1cdf-4ef1-b842-632496bfb478 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:33.809212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-05c7b3a2-1cdf-4ef1-b842-632496bfb478 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:33.810036 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-05c7b3a2-1cdf-4ef1-b842-632496bfb478 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:33.810522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-05c7b3a2-1cdf-4ef1-b842-632496bfb478 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:33.908226 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5f5ff16c-9f11-4e47-a39a-d8fbc20b3e68 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:33.909611 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5f5ff16c-9f11-4e47-a39a-d8fbc20b3e68 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:33.918464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f5ff16c-9f11-4e47-a39a-d8fbc20b3e68 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:33.919058 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f5ff16c-9f11-4e47-a39a-d8fbc20b3e68 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:33.919987 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f5ff16c-9f11-4e47-a39a-d8fbc20b3e68 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:33.920553 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f5ff16c-9f11-4e47-a39a-d8fbc20b3e68 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:33.982868 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-05c7b3a2-1cdf-4ef1-b842-632496bfb478 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 38095 microversion: 2.1 time: 0.186601 Feb 17 03:32:33.984557 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 365/729] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:33 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 38095 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:32:34.245368 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-54790fa2-b19b-4b4d-9449-263ac3e706a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:34.246066 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-54790fa2-b19b-4b4d-9449-263ac3e706a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:34.254743 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54790fa2-b19b-4b4d-9449-263ac3e706a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:34.255315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54790fa2-b19b-4b4d-9449-263ac3e706a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:34.256157 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54790fa2-b19b-4b4d-9449-263ac3e706a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:34.256647 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54790fa2-b19b-4b4d-9449-263ac3e706a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:34.342313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5f5ff16c-9f11-4e47-a39a-d8fbc20b3e68 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 200 len: 38287 microversion: 2.20 time: 0.437821 Feb 17 03:32:34.343741 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 365/730] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:33 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 38287 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:32:34.348372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8cf19b97-b84d-4283-9e9c-6fc2c2c767c9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:34.349091 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8cf19b97-b84d-4283-9e9c-6fc2c2c767c9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:34.358347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8cf19b97-b84d-4283-9e9c-6fc2c2c767c9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:34.358916 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8cf19b97-b84d-4283-9e9c-6fc2c2c767c9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:34.359775 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8cf19b97-b84d-4283-9e9c-6fc2c2c767c9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:34.360251 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8cf19b97-b84d-4283-9e9c-6fc2c2c767c9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:34.484277 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-54790fa2-b19b-4b4d-9449-263ac3e706a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:34.494338 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-54790fa2-b19b-4b4d-9449-263ac3e706a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1271 microversion: 2.1 time: 0.254050 Feb 17 03:32:34.504857 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 366/731] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:34 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:34.510175 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d1d8f002-ee96-489b-950c-7f401215b09d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:34.511442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d1d8f002-ee96-489b-950c-7f401215b09d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:34.520181 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d1d8f002-ee96-489b-950c-7f401215b09d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:34.520899 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d1d8f002-ee96-489b-950c-7f401215b09d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:34.521956 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d1d8f002-ee96-489b-950c-7f401215b09d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:34.522657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d1d8f002-ee96-489b-950c-7f401215b09d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:34.595450 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d1d8f002-ee96-489b-950c-7f401215b09d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/ips" status: 200 len: 149 microversion: 2.20 time: 0.088984 Feb 17 03:32:34.596853 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 367/732] 10.222.0.57 () {60 vars in 1279 bytes} [Wed Feb 17 03:32:34 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/ips => generated 149 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:32:34.617376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8cf19b97-b84d-4283-9e9c-6fc2c2c767c9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:34.631263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8cf19b97-b84d-4283-9e9c-6fc2c2c767c9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1512 microversion: 2.1 time: 0.286978 Feb 17 03:32:34.642064 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 366/733] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:34 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1512 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:34.995856 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3c38b08d-3b60-4c03-a5f1-cbe7666c932f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:34.996905 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3c38b08d-3b60-4c03-a5f1-cbe7666c932f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:35.013357 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3c38b08d-3b60-4c03-a5f1-cbe7666c932f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:35.013913 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3c38b08d-3b60-4c03-a5f1-cbe7666c932f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:35.014699 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3c38b08d-3b60-4c03-a5f1-cbe7666c932f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:35.018183 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3c38b08d-3b60-4c03-a5f1-cbe7666c932f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:35.189254 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3c38b08d-3b60-4c03-a5f1-cbe7666c932f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 200 len: 38226 microversion: 2.1 time: 0.197373 Feb 17 03:32:35.190525 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 368/734] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:34 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 38226 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:32:35.210500 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-db41a64d-01ba-4f7c-a602-8d37d7d53e11 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:35.211029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-db41a64d-01ba-4f7c-a602-8d37d7d53e11 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:35.223373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-db41a64d-01ba-4f7c-a602-8d37d7d53e11 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:35.223888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-db41a64d-01ba-4f7c-a602-8d37d7d53e11 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:35.224723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-db41a64d-01ba-4f7c-a602-8d37d7d53e11 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:35.225449 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-db41a64d-01ba-4f7c-a602-8d37d7d53e11 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:35.287995 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-db41a64d-01ba-4f7c-a602-8d37d7d53e11 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/ips" status: 200 len: 146 microversion: 2.1 time: 0.081309 Feb 17 03:32:35.288530 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 367/735] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Feb 17 03:32:35 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/ips => generated 146 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:35.514213 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-34a952e6-8dc9-487b-9c23-04af742b491e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:35.515538 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-34a952e6-8dc9-487b-9c23-04af742b491e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:35.524634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34a952e6-8dc9-487b-9c23-04af742b491e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:35.525156 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34a952e6-8dc9-487b-9c23-04af742b491e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:35.526321 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34a952e6-8dc9-487b-9c23-04af742b491e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:35.526818 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34a952e6-8dc9-487b-9c23-04af742b491e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:35.649711 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-34908048-ccb2-485c-bede-40117396bb4d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:35.650672 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-34908048-ccb2-485c-bede-40117396bb4d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:35.661605 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34908048-ccb2-485c-bede-40117396bb4d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:35.662351 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34908048-ccb2-485c-bede-40117396bb4d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:35.663416 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34908048-ccb2-485c-bede-40117396bb4d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:35.664101 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34908048-ccb2-485c-bede-40117396bb4d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:35.808768 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-34a952e6-8dc9-487b-9c23-04af742b491e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:35.817702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-34a952e6-8dc9-487b-9c23-04af742b491e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1271 microversion: 2.1 time: 0.309402 Feb 17 03:32:35.818462 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 369/736] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:35 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1271 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:35.830187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-5196d741-8fa2-4907-9a4a-ea6afff232ee req-a0902171-8f19-4545-b589-0510cc2445f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f", "name": "network-vif-deleted", "tag": "2695e8c8-f6c0-48e2-9f5f-06e7275761a5"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:35.831815 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:35.831815 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:32:35.850308 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-34908048-ccb2-485c-bede-40117396bb4d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:35.880422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-5196d741-8fa2-4907-9a4a-ea6afff232ee req-a0902171-8f19-4545-b589-0510cc2445f0 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:35.881085 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-5196d741-8fa2-4907-9a4a-ea6afff232ee req-a0902171-8f19-4545-b589-0510cc2445f0 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:35.882840 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-34908048-ccb2-485c-bede-40117396bb4d tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 200 len: 1470 microversion: 2.1 time: 0.237014 Feb 17 03:32:35.889639 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 368/737] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:35 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 1470 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:35.913473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-5196d741-8fa2-4907-9a4a-ea6afff232ee req-a0902171-8f19-4545-b589-0510cc2445f0 service nova] Creating event network-vif-deleted:2695e8c8-f6c0-48e2-9f5f-06e7275761a5 for instance 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f on hv-cinder-75994 Feb 17 03:32:35.920060 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-5196d741-8fa2-4907-9a4a-ea6afff232ee req-a0902171-8f19-4545-b589-0510cc2445f0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100291 Feb 17 03:32:35.920955 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 370/738] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:36.835870 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7ed1cae5-90af-446f-ac97-525243a02944 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:36.836598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7ed1cae5-90af-446f-ac97-525243a02944 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:36.844906 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7ed1cae5-90af-446f-ac97-525243a02944 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:36.845439 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7ed1cae5-90af-446f-ac97-525243a02944 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:36.846263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7ed1cae5-90af-446f-ac97-525243a02944 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:36.846750 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7ed1cae5-90af-446f-ac97-525243a02944 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:36.907628 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ca13d957-c401-4ef2-a854-fea481cb87e4 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:36.908294 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ca13d957-c401-4ef2-a854-fea481cb87e4 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:36.916599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca13d957-c401-4ef2-a854-fea481cb87e4 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:36.917227 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca13d957-c401-4ef2-a854-fea481cb87e4 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:36.918070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca13d957-c401-4ef2-a854-fea481cb87e4 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:36.918543 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca13d957-c401-4ef2-a854-fea481cb87e4 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:37.064327 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7ed1cae5-90af-446f-ac97-525243a02944 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:37.074278 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7ed1cae5-90af-446f-ac97-525243a02944 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1271 microversion: 2.1 time: 0.242348 Feb 17 03:32:37.074877 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 369/739] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:36 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:37.079850 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fbfea4f0-cc8a-441d-b686-dfa8131cd176 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:37.080558 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fbfea4f0-cc8a-441d-b686-dfa8131cd176 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:37.088142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fbfea4f0-cc8a-441d-b686-dfa8131cd176 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:37.088648 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fbfea4f0-cc8a-441d-b686-dfa8131cd176 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:37.089568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fbfea4f0-cc8a-441d-b686-dfa8131cd176 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:37.090059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fbfea4f0-cc8a-441d-b686-dfa8131cd176 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:37.093123 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-ca13d957-c401-4ef2-a854-fea481cb87e4 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lazy-loading 'services' on Instance uuid ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 {{(pid=98104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:32:37.144030 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-fbfea4f0-cc8a-441d-b686-dfa8131cd176 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] HTTP exception thrown: Instance 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f could not be found. Feb 17 03:32:37.144704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fbfea4f0-cc8a-441d-b686-dfa8131cd176 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Returning 404 to user: Instance 7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f could not be found. {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:32:37.145775 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fbfea4f0-cc8a-441d-b686-dfa8131cd176 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f" status: 404 len: 111 microversion: 2.1 time: 0.069879 Feb 17 03:32:37.146546 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 370/740] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:37 2021] GET /compute/v2.1/servers/7e94fed0-e4c8-44a0-b7df-6e1b44f6f62f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:32:37.265846 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ca13d957-c401-4ef2-a854-fea481cb87e4 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42/os-volume_attachments/9ea053e7-e0e6-438b-a7a8-4703f63e8422" status: 202 len: 0 microversion: 2.1 time: 0.363914 Feb 17 03:32:37.266583 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 371/741] 10.222.0.57 () {58 vars in 1406 bytes} [Wed Feb 17 03:32:36 2021] DELETE /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42/os-volume_attachments/9ea053e7-e0e6-438b-a7a8-4703f63e8422 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:32:38.092636 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-56391824-3bb2-494e-91c9-d83c919f08c4 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:38.093333 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-56391824-3bb2-494e-91c9-d83c919f08c4 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:38.101662 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-56391824-3bb2-494e-91c9-d83c919f08c4 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:38.102116 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-56391824-3bb2-494e-91c9-d83c919f08c4 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:38.102949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-56391824-3bb2-494e-91c9-d83c919f08c4 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:38.103442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-56391824-3bb2-494e-91c9-d83c919f08c4 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:38.319454 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-56391824-3bb2-494e-91c9-d83c919f08c4 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:38.329517 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-56391824-3bb2-494e-91c9-d83c919f08c4 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1271 microversion: 2.1 time: 0.240853 Feb 17 03:32:38.330114 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 371/742] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:38 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1271 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:38.342106 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-531582cb-cdcd-4f70-9d58-6a940c4f7a39 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:38.342882 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-531582cb-cdcd-4f70-9d58-6a940c4f7a39 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:38.351039 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-531582cb-cdcd-4f70-9d58-6a940c4f7a39 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:38.351714 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-531582cb-cdcd-4f70-9d58-6a940c4f7a39 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:38.352581 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-531582cb-cdcd-4f70-9d58-6a940c4f7a39 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:38.353176 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-531582cb-cdcd-4f70-9d58-6a940c4f7a39 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:38.416734 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-531582cb-cdcd-4f70-9d58-6a940c4f7a39 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lazy-loading 'flavor' on Instance uuid 4840bec6-59fa-4a75-9cab-b8eba3fced9d {{(pid=98104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:32:38.791900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-531582cb-cdcd-4f70-9d58-6a940c4f7a39 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 202 len: 0 microversion: 2.20 time: 0.455129 Feb 17 03:32:38.792728 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 372/743] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:32:38 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:32:38.801400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3add71b5-30a9-48e5-8335-9553fa4fcdd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:38.802064 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3add71b5-30a9-48e5-8335-9553fa4fcdd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:38.810443 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3add71b5-30a9-48e5-8335-9553fa4fcdd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:38.811059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3add71b5-30a9-48e5-8335-9553fa4fcdd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:38.811817 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3add71b5-30a9-48e5-8335-9553fa4fcdd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:38.812304 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3add71b5-30a9-48e5-8335-9553fa4fcdd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:39.028749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3add71b5-30a9-48e5-8335-9553fa4fcdd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:39.038023 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3add71b5-30a9-48e5-8335-9553fa4fcdd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:39.039603 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3add71b5-30a9-48e5-8335-9553fa4fcdd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:39.041327 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3add71b5-30a9-48e5-8335-9553fa4fcdd4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1720 microversion: 2.20 time: 0.244050 Feb 17 03:32:39.041897 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 372/744] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:38 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1720 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:39.045508 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-00423914-100d-4c64-8b90-599c6cd77e6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b26d6c4-47a3-4c01-af17-872394f02d4d"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:39.046790 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-00423914-100d-4c64-8b90-599c6cd77e6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:39.056308 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-00423914-100d-4c64-8b90-599c6cd77e6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:39.056819 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-00423914-100d-4c64-8b90-599c6cd77e6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:39.057721 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-00423914-100d-4c64-8b90-599c6cd77e6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:39.058215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-00423914-100d-4c64-8b90-599c6cd77e6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:39.348303 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e48a4286-5cb7-42b8-857d-c07c22c873fc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:39.348948 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e48a4286-5cb7-42b8-857d-c07c22c873fc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:39.357890 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e48a4286-5cb7-42b8-857d-c07c22c873fc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:39.358639 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e48a4286-5cb7-42b8-857d-c07c22c873fc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:39.359479 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e48a4286-5cb7-42b8-857d-c07c22c873fc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:39.359966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e48a4286-5cb7-42b8-857d-c07c22c873fc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:39.502374 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-00423914-100d-4c64-8b90-599c6cd77e6f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.462435 Feb 17 03:32:39.503144 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 373/745] 10.222.0.57 () {60 vars in 1313 bytes} [Wed Feb 17 03:32:39 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/os-volume_attachments => generated 194 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:32:39.544608 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-89cedc71-b195-4eb0-b553-7dfdf6c8a91b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:39.545384 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-89cedc71-b195-4eb0-b553-7dfdf6c8a91b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:39.558168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-89cedc71-b195-4eb0-b553-7dfdf6c8a91b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:39.558340 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-89cedc71-b195-4eb0-b553-7dfdf6c8a91b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:39.559278 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-89cedc71-b195-4eb0-b553-7dfdf6c8a91b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:39.559883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-89cedc71-b195-4eb0-b553-7dfdf6c8a91b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:39.590697 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e48a4286-5cb7-42b8-857d-c07c22c873fc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:39.602035 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e48a4286-5cb7-42b8-857d-c07c22c873fc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1271 microversion: 2.1 time: 0.257944 Feb 17 03:32:39.602928 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 373/746] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:39 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1271 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:39.628240 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-89cedc71-b195-4eb0-b553-7dfdf6c8a91b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Going to try to terminate instance {{(pid=98104) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:32:39.682824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c474f98d-3583-463d-a55b-f05fe2eab0ec tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:39.683937 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c474f98d-3583-463d-a55b-f05fe2eab0ec tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:39.691969 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c474f98d-3583-463d-a55b-f05fe2eab0ec tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:39.692456 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c474f98d-3583-463d-a55b-f05fe2eab0ec tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:39.693547 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c474f98d-3583-463d-a55b-f05fe2eab0ec tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:39.694042 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c474f98d-3583-463d-a55b-f05fe2eab0ec tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:39.745105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-89cedc71-b195-4eb0-b553-7dfdf6c8a91b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 204 len: 0 microversion: 2.1 time: 0.205452 Feb 17 03:32:39.745663 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 374/747] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:32:39 2021] DELETE /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 17 03:32:39.754524 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b2c86071-222b-4dec-9887-2e82bf343d53 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:39.755281 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b2c86071-222b-4dec-9887-2e82bf343d53 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:39.763560 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b2c86071-222b-4dec-9887-2e82bf343d53 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:39.764134 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b2c86071-222b-4dec-9887-2e82bf343d53 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:39.765005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b2c86071-222b-4dec-9887-2e82bf343d53 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:39.765599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b2c86071-222b-4dec-9887-2e82bf343d53 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:39.766762 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c474f98d-3583-463d-a55b-f05fe2eab0ec tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Going to try to terminate instance {{(pid=98103) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:32:39.928032 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c474f98d-3583-463d-a55b-f05fe2eab0ec tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 204 len: 0 microversion: 2.1 time: 0.249651 Feb 17 03:32:39.928928 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 374/748] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:32:39 2021] DELETE /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 17 03:32:39.938839 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-da77e047-7798-43f4-b83e-7ae946ed9341 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:39.939630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-da77e047-7798-43f4-b83e-7ae946ed9341 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:39.948656 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da77e047-7798-43f4-b83e-7ae946ed9341 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:39.949205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da77e047-7798-43f4-b83e-7ae946ed9341 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:39.950171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da77e047-7798-43f4-b83e-7ae946ed9341 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:39.950674 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da77e047-7798-43f4-b83e-7ae946ed9341 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:40.040959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b2c86071-222b-4dec-9887-2e82bf343d53 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:40.049979 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b2c86071-222b-4dec-9887-2e82bf343d53 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1514 microversion: 2.1 time: 0.299889 Feb 17 03:32:40.050755 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 375/749] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:39 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1514 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:40.066889 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7f6927a1-6858-41c3-a04f-3d0ed1af4d32 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:40.067792 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7f6927a1-6858-41c3-a04f-3d0ed1af4d32 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:40.076460 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f6927a1-6858-41c3-a04f-3d0ed1af4d32 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:40.077008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f6927a1-6858-41c3-a04f-3d0ed1af4d32 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:40.078990 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f6927a1-6858-41c3-a04f-3d0ed1af4d32 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:40.078990 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f6927a1-6858-41c3-a04f-3d0ed1af4d32 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:40.181235 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-da77e047-7798-43f4-b83e-7ae946ed9341 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:40.191190 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-da77e047-7798-43f4-b83e-7ae946ed9341 tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1513 microversion: 2.1 time: 0.256892 Feb 17 03:32:40.191933 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 375/750] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:39 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1513 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:40.294335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7f6927a1-6858-41c3-a04f-3d0ed1af4d32 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:40.303920 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7f6927a1-6858-41c3-a04f-3d0ed1af4d32 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:40.306074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7f6927a1-6858-41c3-a04f-3d0ed1af4d32 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:40.307251 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7f6927a1-6858-41c3-a04f-3d0ed1af4d32 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1720 microversion: 2.20 time: 0.244778 Feb 17 03:32:40.307828 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 376/751] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:40 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1720 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:32:40.620736 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ddde31e0-66a2-45d4-9b35-51dfc494be7f tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:40.621471 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ddde31e0-66a2-45d4-9b35-51dfc494be7f tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:40.629682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ddde31e0-66a2-45d4-9b35-51dfc494be7f tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:40.630403 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ddde31e0-66a2-45d4-9b35-51dfc494be7f tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:40.631044 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ddde31e0-66a2-45d4-9b35-51dfc494be7f tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:40.631521 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ddde31e0-66a2-45d4-9b35-51dfc494be7f tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:40.889716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ddde31e0-66a2-45d4-9b35-51dfc494be7f tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:40.898797 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ddde31e0-66a2-45d4-9b35-51dfc494be7f tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1271 microversion: 2.1 time: 0.282684 Feb 17 03:32:40.899864 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 376/752] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:40 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1271 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:41.070562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6937b446-695d-4c06-858f-3ecbf3bc637e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:41.071947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6937b446-695d-4c06-858f-3ecbf3bc637e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:41.080497 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6937b446-695d-4c06-858f-3ecbf3bc637e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:41.081107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6937b446-695d-4c06-858f-3ecbf3bc637e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:41.081973 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6937b446-695d-4c06-858f-3ecbf3bc637e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:41.082478 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6937b446-695d-4c06-858f-3ecbf3bc637e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:41.212249 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7242390e-477d-46c5-9d14-a8aea07a988f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:41.212926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7242390e-477d-46c5-9d14-a8aea07a988f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:41.229592 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7242390e-477d-46c5-9d14-a8aea07a988f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:41.230001 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7242390e-477d-46c5-9d14-a8aea07a988f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:41.230861 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7242390e-477d-46c5-9d14-a8aea07a988f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:41.231358 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7242390e-477d-46c5-9d14-a8aea07a988f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:41.313557 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6937b446-695d-4c06-858f-3ecbf3bc637e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:41.323430 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6937b446-695d-4c06-858f-3ecbf3bc637e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1514 microversion: 2.1 time: 0.257122 Feb 17 03:32:41.324041 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 377/753] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:41 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1514 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:41.328718 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-702d43a5-7935-4b84-a959-2daf775e219c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:41.329438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-702d43a5-7935-4b84-a959-2daf775e219c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:41.337598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-702d43a5-7935-4b84-a959-2daf775e219c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:41.338053 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-702d43a5-7935-4b84-a959-2daf775e219c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:41.338901 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-702d43a5-7935-4b84-a959-2daf775e219c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:41.339396 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-702d43a5-7935-4b84-a959-2daf775e219c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:41.502773 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7242390e-477d-46c5-9d14-a8aea07a988f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:41.515043 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7242390e-477d-46c5-9d14-a8aea07a988f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1513 microversion: 2.1 time: 0.308460 Feb 17 03:32:41.525431 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 377/754] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:41 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1513 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:41.572876 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-702d43a5-7935-4b84-a959-2daf775e219c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:41.582236 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-702d43a5-7935-4b84-a959-2daf775e219c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:41.583817 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-702d43a5-7935-4b84-a959-2daf775e219c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:41.585005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-702d43a5-7935-4b84-a959-2daf775e219c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1720 microversion: 2.20 time: 0.259968 Feb 17 03:32:41.585665 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 378/755] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:41 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1720 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:41.918397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-49d6dfa2-d652-4f01-ab90-3878a61bf934 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:41.919128 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-49d6dfa2-d652-4f01-ab90-3878a61bf934 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:41.927167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-49d6dfa2-d652-4f01-ab90-3878a61bf934 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:41.927679 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-49d6dfa2-d652-4f01-ab90-3878a61bf934 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:41.928954 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-49d6dfa2-d652-4f01-ab90-3878a61bf934 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:41.929099 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-49d6dfa2-d652-4f01-ab90-3878a61bf934 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:42.144429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-49d6dfa2-d652-4f01-ab90-3878a61bf934 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:42.153362 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-49d6dfa2-d652-4f01-ab90-3878a61bf934 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1271 microversion: 2.1 time: 0.239569 Feb 17 03:32:42.153963 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 378/756] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:41 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1271 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:42.341135 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cc9a95a2-c073-481c-b91c-1ded3112218e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:42.341804 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cc9a95a2-c073-481c-b91c-1ded3112218e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:42.349516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cc9a95a2-c073-481c-b91c-1ded3112218e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:42.350021 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cc9a95a2-c073-481c-b91c-1ded3112218e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:42.350861 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cc9a95a2-c073-481c-b91c-1ded3112218e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:42.351356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cc9a95a2-c073-481c-b91c-1ded3112218e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:42.533724 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b05a83f6-b955-4e5c-a56b-616ff5004acb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:42.534554 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b05a83f6-b955-4e5c-a56b-616ff5004acb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:42.543735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b05a83f6-b955-4e5c-a56b-616ff5004acb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:42.544349 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b05a83f6-b955-4e5c-a56b-616ff5004acb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:42.545333 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b05a83f6-b955-4e5c-a56b-616ff5004acb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:42.546013 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b05a83f6-b955-4e5c-a56b-616ff5004acb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:42.720654 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-cc9a95a2-c073-481c-b91c-1ded3112218e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:42.732954 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cc9a95a2-c073-481c-b91c-1ded3112218e tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1514 microversion: 2.1 time: 0.395429 Feb 17 03:32:42.734025 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 379/757] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:42 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1514 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:42.747991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8384574c-5e6f-4a2a-abf3-cd2e3f3f8e5e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:42.748893 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8384574c-5e6f-4a2a-abf3-cd2e3f3f8e5e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:42.757405 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8384574c-5e6f-4a2a-abf3-cd2e3f3f8e5e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:42.757913 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8384574c-5e6f-4a2a-abf3-cd2e3f3f8e5e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:42.759509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8384574c-5e6f-4a2a-abf3-cd2e3f3f8e5e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:42.760009 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8384574c-5e6f-4a2a-abf3-cd2e3f3f8e5e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:42.768703 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b05a83f6-b955-4e5c-a56b-616ff5004acb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:42.778476 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b05a83f6-b955-4e5c-a56b-616ff5004acb tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1513 microversion: 2.1 time: 0.249456 Feb 17 03:32:42.779613 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 379/758] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:42 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1513 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:43.171666 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-959b3e87-c093-4923-a74e-5bbf2fd829b0 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:43.172357 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-959b3e87-c093-4923-a74e-5bbf2fd829b0 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:43.181214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-959b3e87-c093-4923-a74e-5bbf2fd829b0 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:43.181910 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-959b3e87-c093-4923-a74e-5bbf2fd829b0 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:43.182808 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-959b3e87-c093-4923-a74e-5bbf2fd829b0 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:43.183682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-959b3e87-c093-4923-a74e-5bbf2fd829b0 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:43.431863 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-959b3e87-c093-4923-a74e-5bbf2fd829b0 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:43.442595 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-959b3e87-c093-4923-a74e-5bbf2fd829b0 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1271 microversion: 2.1 time: 0.274998 Feb 17 03:32:43.443214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 380/759] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:43 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1271 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:43.448392 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-1f6d219d-9a4a-482d-8f20-6048e96b1c87 req-371a24af-35da-4744-af86-e4e0db4399ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c691a18-0bdc-4921-9246-3de1981b4c2b", "name": "network-vif-unplugged", "status": "completed", "tag": "a0f6513d-f485-4f7e-a35c-1db2dcf6b082"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:43.450447 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:43.450447 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:32:43.459427 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-1f6d219d-9a4a-482d-8f20-6048e96b1c87 req-371a24af-35da-4744-af86-e4e0db4399ae service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:43.460019 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-1f6d219d-9a4a-482d-8f20-6048e96b1c87 req-371a24af-35da-4744-af86-e4e0db4399ae service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:43.482148 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-1f6d219d-9a4a-482d-8f20-6048e96b1c87 req-371a24af-35da-4744-af86-e4e0db4399ae service nova] Creating event network-vif-unplugged:a0f6513d-f485-4f7e-a35c-1db2dcf6b082 for instance 9c691a18-0bdc-4921-9246-3de1981b4c2b on hv-cinder-75994 Feb 17 03:32:43.487441 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-1f6d219d-9a4a-482d-8f20-6048e96b1c87 req-371a24af-35da-4744-af86-e4e0db4399ae service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043055 Feb 17 03:32:43.488309 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 381/760] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:43 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:43.719034 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8384574c-5e6f-4a2a-abf3-cd2e3f3f8e5e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:43.729571 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8384574c-5e6f-4a2a-abf3-cd2e3f3f8e5e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:43.731380 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8384574c-5e6f-4a2a-abf3-cd2e3f3f8e5e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:43.732623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8384574c-5e6f-4a2a-abf3-cd2e3f3f8e5e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1720 microversion: 2.20 time: 0.992995 Feb 17 03:32:43.733162 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 380/761] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:42 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1720 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:43.753212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a6038c1b-8891-4ef3-8c2f-e066bfdcdcc8 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:43.754164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a6038c1b-8891-4ef3-8c2f-e066bfdcdcc8 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:43.763622 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a6038c1b-8891-4ef3-8c2f-e066bfdcdcc8 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:43.764366 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a6038c1b-8891-4ef3-8c2f-e066bfdcdcc8 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:43.765418 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a6038c1b-8891-4ef3-8c2f-e066bfdcdcc8 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:43.766490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a6038c1b-8891-4ef3-8c2f-e066bfdcdcc8 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:43.796801 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2cf7b183-b797-4832-b4f1-3bfa193aae3c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:43.797391 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2cf7b183-b797-4832-b4f1-3bfa193aae3c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:43.810980 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2cf7b183-b797-4832-b4f1-3bfa193aae3c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:43.811497 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2cf7b183-b797-4832-b4f1-3bfa193aae3c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:43.812360 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2cf7b183-b797-4832-b4f1-3bfa193aae3c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:43.812860 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2cf7b183-b797-4832-b4f1-3bfa193aae3c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:44.023215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a6038c1b-8891-4ef3-8c2f-e066bfdcdcc8 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:44.032954 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a6038c1b-8891-4ef3-8c2f-e066bfdcdcc8 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1514 microversion: 2.1 time: 0.284798 Feb 17 03:32:44.033698 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 382/762] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:43 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1514 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:44.415439 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2cf7b183-b797-4832-b4f1-3bfa193aae3c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:44.424489 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2cf7b183-b797-4832-b4f1-3bfa193aae3c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1513 microversion: 2.1 time: 0.631925 Feb 17 03:32:44.425104 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 381/763] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:43 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1513 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:44.459957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c721ae98-eb82-4fbc-a8cf-860bcf4ff936 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:44.460661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c721ae98-eb82-4fbc-a8cf-860bcf4ff936 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:44.468593 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c721ae98-eb82-4fbc-a8cf-860bcf4ff936 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:44.469150 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c721ae98-eb82-4fbc-a8cf-860bcf4ff936 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:44.469986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c721ae98-eb82-4fbc-a8cf-860bcf4ff936 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:44.470470 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c721ae98-eb82-4fbc-a8cf-860bcf4ff936 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:44.687852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c721ae98-eb82-4fbc-a8cf-860bcf4ff936 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:44.697984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c721ae98-eb82-4fbc-a8cf-860bcf4ff936 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1271 microversion: 2.1 time: 0.242057 Feb 17 03:32:44.698690 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 383/764] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:44 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1271 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:44.752261 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4f3e26af-46b7-40f2-9769-f3b2d3c0f829 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:44.752929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4f3e26af-46b7-40f2-9769-f3b2d3c0f829 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:44.761472 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4f3e26af-46b7-40f2-9769-f3b2d3c0f829 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:44.762073 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4f3e26af-46b7-40f2-9769-f3b2d3c0f829 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:44.762908 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4f3e26af-46b7-40f2-9769-f3b2d3c0f829 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:44.763399 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4f3e26af-46b7-40f2-9769-f3b2d3c0f829 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:45.051850 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-15c8c6ec-bcb6-41c2-93c4-882bb3040782 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:45.052677 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-15c8c6ec-bcb6-41c2-93c4-882bb3040782 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:45.061237 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-15c8c6ec-bcb6-41c2-93c4-882bb3040782 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:45.061741 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-15c8c6ec-bcb6-41c2-93c4-882bb3040782 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:45.062575 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-15c8c6ec-bcb6-41c2-93c4-882bb3040782 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:45.063062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-15c8c6ec-bcb6-41c2-93c4-882bb3040782 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:45.279009 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-15c8c6ec-bcb6-41c2-93c4-882bb3040782 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:45.288285 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-15c8c6ec-bcb6-41c2-93c4-882bb3040782 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1514 microversion: 2.1 time: 0.240410 Feb 17 03:32:45.289244 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 384/765] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:45 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:45.294705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-e9f38011-3e28-4eca-a0a1-dc3314fefff5 req-2cbdf244-0d9f-4662-8c33-59d4e20b9854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed26f5aa-77e4-4e92-b7bf-20ae530ebe42", "name": "network-vif-deleted", "tag": "859d2cf9-e281-49ce-9ffd-0ab7067e438e"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:45.296537 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:45.296537 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:32:45.305516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-e9f38011-3e28-4eca-a0a1-dc3314fefff5 req-2cbdf244-0d9f-4662-8c33-59d4e20b9854 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:45.306151 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-e9f38011-3e28-4eca-a0a1-dc3314fefff5 req-2cbdf244-0d9f-4662-8c33-59d4e20b9854 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:45.324160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-e9f38011-3e28-4eca-a0a1-dc3314fefff5 req-2cbdf244-0d9f-4662-8c33-59d4e20b9854 service nova] Creating event network-vif-deleted:859d2cf9-e281-49ce-9ffd-0ab7067e438e for instance ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 on hv-cinder-75994 Feb 17 03:32:45.329518 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-e9f38011-3e28-4eca-a0a1-dc3314fefff5 req-2cbdf244-0d9f-4662-8c33-59d4e20b9854 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038268 Feb 17 03:32:45.330393 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 385/766] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:45.378784 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4f3e26af-46b7-40f2-9769-f3b2d3c0f829 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:45.390373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4f3e26af-46b7-40f2-9769-f3b2d3c0f829 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:45.391957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4f3e26af-46b7-40f2-9769-f3b2d3c0f829 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:45.393343 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4f3e26af-46b7-40f2-9769-f3b2d3c0f829 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1720 microversion: 2.20 time: 0.645270 Feb 17 03:32:45.394197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 382/767] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:44 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1720 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:45.443229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9cd48f3b-3346-40df-9cd3-0fca692b8f1c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:45.444116 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9cd48f3b-3346-40df-9cd3-0fca692b8f1c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:45.453152 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9cd48f3b-3346-40df-9cd3-0fca692b8f1c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:45.453868 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9cd48f3b-3346-40df-9cd3-0fca692b8f1c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:45.454888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9cd48f3b-3346-40df-9cd3-0fca692b8f1c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:45.455465 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9cd48f3b-3346-40df-9cd3-0fca692b8f1c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:45.592171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9cd48f3b-3346-40df-9cd3-0fca692b8f1c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03ffe03f3f7040418e36d56834cbb18e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b33b201e9c4aaa92ca566c8f7e6dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:45.602429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9cd48f3b-3346-40df-9cd3-0fca692b8f1c tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 200 len: 1303 microversion: 2.1 time: 0.163601 Feb 17 03:32:45.603270 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 386/768] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:45 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 1303 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:45.718274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-eb71588a-d4c0-432e-8890-e88f0f24e1f1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:45.719007 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-eb71588a-d4c0-432e-8890-e88f0f24e1f1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:45.727186 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eb71588a-d4c0-432e-8890-e88f0f24e1f1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:45.727696 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eb71588a-d4c0-432e-8890-e88f0f24e1f1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:45.728589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eb71588a-d4c0-432e-8890-e88f0f24e1f1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:45.729112 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eb71588a-d4c0-432e-8890-e88f0f24e1f1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:45.819369 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-9d605498-653f-49a3-9df5-2ae0f7bb043f req-1d944bcc-3692-494f-b0c0-20d94044dc4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce920548-efb2-455b-a260-d9b321d73cd9", "name": "network-vif-plugged", "status": "completed", "tag": "ce570470-08b9-4b72-be9b-4b61e88ce552"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:45.822237 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:45.822237 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:32:45.830869 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-9d605498-653f-49a3-9df5-2ae0f7bb043f req-1d944bcc-3692-494f-b0c0-20d94044dc4e service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:45.831371 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-9d605498-653f-49a3-9df5-2ae0f7bb043f req-1d944bcc-3692-494f-b0c0-20d94044dc4e service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:45.862910 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-9d605498-653f-49a3-9df5-2ae0f7bb043f req-1d944bcc-3692-494f-b0c0-20d94044dc4e service nova] Creating event network-vif-plugged:ce570470-08b9-4b72-be9b-4b61e88ce552 for instance ce920548-efb2-455b-a260-d9b321d73cd9 on hv-cinder-75994 Feb 17 03:32:45.871428 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-9d605498-653f-49a3-9df5-2ae0f7bb043f req-1d944bcc-3692-494f-b0c0-20d94044dc4e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055862 Feb 17 03:32:45.872475 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 387/769] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:32:45.958951 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-eb71588a-d4c0-432e-8890-e88f0f24e1f1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:45.976555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-eb71588a-d4c0-432e-8890-e88f0f24e1f1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1271 microversion: 2.1 time: 0.262133 Feb 17 03:32:45.977975 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 383/770] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:45 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:46.308273 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e79913fb-8ddf-4188-8b78-f9ac8fd89b98 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:46.309054 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e79913fb-8ddf-4188-8b78-f9ac8fd89b98 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:46.317494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e79913fb-8ddf-4188-8b78-f9ac8fd89b98 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:46.318107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e79913fb-8ddf-4188-8b78-f9ac8fd89b98 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:46.319024 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e79913fb-8ddf-4188-8b78-f9ac8fd89b98 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:46.319580 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e79913fb-8ddf-4188-8b78-f9ac8fd89b98 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:46.393595 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e79913fb-8ddf-4188-8b78-f9ac8fd89b98 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:46.394102 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e79913fb-8ddf-4188-8b78-f9ac8fd89b98 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:46.394611 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-e79913fb-8ddf-4188-8b78-f9ac8fd89b98 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lazy-loading 'fault' on Instance uuid 9c691a18-0bdc-4921-9246-3de1981b4c2b {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:32:46.413511 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ae88bd84-7ba7-4c88-9dd1-aa6318e4bd3d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:46.414427 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ae88bd84-7ba7-4c88-9dd1-aa6318e4bd3d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:46.422789 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ae88bd84-7ba7-4c88-9dd1-aa6318e4bd3d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:46.423298 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ae88bd84-7ba7-4c88-9dd1-aa6318e4bd3d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:46.424134 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ae88bd84-7ba7-4c88-9dd1-aa6318e4bd3d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:46.424623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ae88bd84-7ba7-4c88-9dd1-aa6318e4bd3d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:46.461852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e79913fb-8ddf-4188-8b78-f9ac8fd89b98 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:46.471125 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e79913fb-8ddf-4188-8b78-f9ac8fd89b98 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 200 len: 1308 microversion: 2.1 time: 0.168089 Feb 17 03:32:46.471809 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 388/771] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:46 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 1308 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:46.620795 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9d2ffdbd-153e-4535-897d-a625adbfeb2f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:46.622063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9d2ffdbd-153e-4535-897d-a625adbfeb2f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] [instance: ed26f5aa-77e4-4e92-b7bf-20ae530ebe42] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:46.630623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9d2ffdbd-153e-4535-897d-a625adbfeb2f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:46.631133 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9d2ffdbd-153e-4535-897d-a625adbfeb2f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:46.632194 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9d2ffdbd-153e-4535-897d-a625adbfeb2f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:46.632685 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9d2ffdbd-153e-4535-897d-a625adbfeb2f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:46.638472 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ae88bd84-7ba7-4c88-9dd1-aa6318e4bd3d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:46.648234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ae88bd84-7ba7-4c88-9dd1-aa6318e4bd3d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:46.650079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ae88bd84-7ba7-4c88-9dd1-aa6318e4bd3d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:46.651280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ae88bd84-7ba7-4c88-9dd1-aa6318e4bd3d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1720 microversion: 2.20 time: 0.242058 Feb 17 03:32:46.651876 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 384/772] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:46 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1720 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:32:46.689979 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-9d2ffdbd-153e-4535-897d-a625adbfeb2f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] HTTP exception thrown: Instance ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 could not be found. Feb 17 03:32:46.690734 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9d2ffdbd-153e-4535-897d-a625adbfeb2f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] Returning 404 to user: Instance ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 could not be found. {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:32:46.691659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9d2ffdbd-153e-4535-897d-a625adbfeb2f tempest-VolumesSnapshotTestJSON-1509273995 tempest-VolumesSnapshotTestJSON-1509273995-project] 10.222.0.57 "GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42" status: 404 len: 111 microversion: 2.1 time: 0.075720 Feb 17 03:32:46.692261 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 389/773] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:46 2021] GET /compute/v2.1/servers/ed26f5aa-77e4-4e92-b7bf-20ae530ebe42 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 03:32:46.996199 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c3b9238c-31f8-4307-898d-616917926677 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:46.996978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c3b9238c-31f8-4307-898d-616917926677 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:47.005347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3b9238c-31f8-4307-898d-616917926677 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:47.005936 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3b9238c-31f8-4307-898d-616917926677 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:47.006882 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3b9238c-31f8-4307-898d-616917926677 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:47.007509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3b9238c-31f8-4307-898d-616917926677 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:47.279435 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c3b9238c-31f8-4307-898d-616917926677 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:47.289198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c3b9238c-31f8-4307-898d-616917926677 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1271 microversion: 2.1 time: 0.297488 Feb 17 03:32:47.289824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 385/774] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:46 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1271 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:47.489676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e5cf664a-7cf9-40e3-9e2a-b41b5cf0f135 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:47.490495 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e5cf664a-7cf9-40e3-9e2a-b41b5cf0f135 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 9c691a18-0bdc-4921-9246-3de1981b4c2b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:47.505839 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5cf664a-7cf9-40e3-9e2a-b41b5cf0f135 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:47.514021 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5cf664a-7cf9-40e3-9e2a-b41b5cf0f135 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:47.515065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5cf664a-7cf9-40e3-9e2a-b41b5cf0f135 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:47.515700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5cf664a-7cf9-40e3-9e2a-b41b5cf0f135 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:47.519505 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-bed0fd79-b1a4-49d6-aaad-693e2fecef1e req-ac048ed7-3748-4a94-a421-61eb685ca3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c691a18-0bdc-4921-9246-3de1981b4c2b", "name": "network-vif-deleted", "tag": "a0f6513d-f485-4f7e-a35c-1db2dcf6b082"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:47.521427 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:47.521427 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:32:47.538248 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-bed0fd79-b1a4-49d6-aaad-693e2fecef1e req-ac048ed7-3748-4a94-a421-61eb685ca3e4 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:47.538747 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-bed0fd79-b1a4-49d6-aaad-693e2fecef1e req-ac048ed7-3748-4a94-a421-61eb685ca3e4 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:47.569896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-bed0fd79-b1a4-49d6-aaad-693e2fecef1e req-ac048ed7-3748-4a94-a421-61eb685ca3e4 service nova] Creating event network-vif-deleted:a0f6513d-f485-4f7e-a35c-1db2dcf6b082 for instance 9c691a18-0bdc-4921-9246-3de1981b4c2b on hv-cinder-75994 Feb 17 03:32:47.576095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-bed0fd79-b1a4-49d6-aaad-693e2fecef1e req-ac048ed7-3748-4a94-a421-61eb685ca3e4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232005 Feb 17 03:32:47.577098 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 390/775] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:47.594091 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-e5cf664a-7cf9-40e3-9e2a-b41b5cf0f135 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] HTTP exception thrown: Instance 9c691a18-0bdc-4921-9246-3de1981b4c2b could not be found. Feb 17 03:32:47.594650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e5cf664a-7cf9-40e3-9e2a-b41b5cf0f135 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Returning 404 to user: Instance 9c691a18-0bdc-4921-9246-3de1981b4c2b could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:32:47.595559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e5cf664a-7cf9-40e3-9e2a-b41b5cf0f135 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b" status: 404 len: 111 microversion: 2.1 time: 0.109922 Feb 17 03:32:47.596347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 386/776] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:47 2021] GET /compute/v2.1/servers/9c691a18-0bdc-4921-9246-3de1981b4c2b => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:32:47.606994 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-16b41db2-cdd9-4aad-8e32-006581e12fca tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:47.608010 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-16b41db2-cdd9-4aad-8e32-006581e12fca tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:47.616323 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-16b41db2-cdd9-4aad-8e32-006581e12fca tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:47.616840 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-16b41db2-cdd9-4aad-8e32-006581e12fca tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:47.618277 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-16b41db2-cdd9-4aad-8e32-006581e12fca tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:47.618775 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-16b41db2-cdd9-4aad-8e32-006581e12fca tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:47.696992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-16b41db2-cdd9-4aad-8e32-006581e12fca tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Going to try to terminate instance {{(pid=98103) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:32:47.815189 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3a606dcf-8cef-488a-b012-cb0a5f652590 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:47.815982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3a606dcf-8cef-488a-b012-cb0a5f652590 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:47.827118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3a606dcf-8cef-488a-b012-cb0a5f652590 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:47.827331 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-16b41db2-cdd9-4aad-8e32-006581e12fca tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 204 len: 0 microversion: 2.1 time: 0.224507 Feb 17 03:32:47.828009 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 391/777] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:32:47 2021] DELETE /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:32:47.828303 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3a606dcf-8cef-488a-b012-cb0a5f652590 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:47.829277 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3a606dcf-8cef-488a-b012-cb0a5f652590 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:47.829782 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3a606dcf-8cef-488a-b012-cb0a5f652590 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:47.837100 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e4505383-9df7-47e9-9117-40c95a3832ea tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:47.837866 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e4505383-9df7-47e9-9117-40c95a3832ea tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:47.845820 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e4505383-9df7-47e9-9117-40c95a3832ea tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:47.846460 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e4505383-9df7-47e9-9117-40c95a3832ea tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:47.847294 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e4505383-9df7-47e9-9117-40c95a3832ea tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:47.847795 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e4505383-9df7-47e9-9117-40c95a3832ea tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:48.076190 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3a606dcf-8cef-488a-b012-cb0a5f652590 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:48.085601 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3a606dcf-8cef-488a-b012-cb0a5f652590 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:48.087234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3a606dcf-8cef-488a-b012-cb0a5f652590 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:48.088414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3a606dcf-8cef-488a-b012-cb0a5f652590 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1720 microversion: 2.20 time: 0.421257 Feb 17 03:32:48.089001 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 387/778] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:47 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1720 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:48.213331 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e4505383-9df7-47e9-9117-40c95a3832ea tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:48.222421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e4505383-9df7-47e9-9117-40c95a3832ea tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1512 microversion: 2.1 time: 0.389739 Feb 17 03:32:48.223305 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 392/779] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:47 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1512 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:48.307213 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-05795a97-9eb8-4d24-9124-1ae6da7ba0f3 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:48.307841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-05795a97-9eb8-4d24-9124-1ae6da7ba0f3 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:48.315817 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-05795a97-9eb8-4d24-9124-1ae6da7ba0f3 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:48.316329 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-05795a97-9eb8-4d24-9124-1ae6da7ba0f3 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:48.317220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-05795a97-9eb8-4d24-9124-1ae6da7ba0f3 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:48.317722 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-05795a97-9eb8-4d24-9124-1ae6da7ba0f3 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:48.578363 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-741b0450-2338-4289-9d64-014885073db0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:48.589565 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-741b0450-2338-4289-9d64-014885073db0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:48.590059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-741b0450-2338-4289-9d64-014885073db0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:48.653886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-741b0450-2338-4289-9d64-014885073db0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Going to try to stop instance {{(pid=98103) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Feb 17 03:32:48.731930 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-741b0450-2338-4289-9d64-014885073db0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 202 len: 0 microversion: 2.1 time: 0.157728 Feb 17 03:32:48.732643 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 393/780] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:48 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:32:48.741532 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-dc0cc909-b20b-49d8-a170-bb70b18c400c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:48.742409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-dc0cc909-b20b-49d8-a170-bb70b18c400c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:48.750372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dc0cc909-b20b-49d8-a170-bb70b18c400c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:48.750879 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dc0cc909-b20b-49d8-a170-bb70b18c400c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:48.751725 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dc0cc909-b20b-49d8-a170-bb70b18c400c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:48.752245 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dc0cc909-b20b-49d8-a170-bb70b18c400c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:48.759073 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-05795a97-9eb8-4d24-9124-1ae6da7ba0f3 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:48.767920 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-05795a97-9eb8-4d24-9124-1ae6da7ba0f3 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1458 microversion: 2.1 time: 0.464711 Feb 17 03:32:48.768509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 388/781] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:48 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1458 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:48.785232 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6b8e7a09-fb0f-4ceb-8808-8b6436de6e3e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:48.785902 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6b8e7a09-fb0f-4ceb-8808-8b6436de6e3e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:48.793834 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6b8e7a09-fb0f-4ceb-8808-8b6436de6e3e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:48.794344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6b8e7a09-fb0f-4ceb-8808-8b6436de6e3e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:48.795186 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6b8e7a09-fb0f-4ceb-8808-8b6436de6e3e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:48.795704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6b8e7a09-fb0f-4ceb-8808-8b6436de6e3e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:48.985638 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dc0cc909-b20b-49d8-a170-bb70b18c400c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:48.996533 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-dc0cc909-b20b-49d8-a170-bb70b18c400c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1724 microversion: 2.1 time: 0.259215 Feb 17 03:32:48.997259 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 394/782] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:48 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:49.032386 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6b8e7a09-fb0f-4ceb-8808-8b6436de6e3e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:49.041629 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6b8e7a09-fb0f-4ceb-8808-8b6436de6e3e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1458 microversion: 2.1 time: 0.260062 Feb 17 03:32:49.042207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 389/783] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:48 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1458 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:49.059854 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-dd2a47ce-4181-4bbd-9e94-4650add4f8e3 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Action: 'create', calling method: .version_select at 0x7f98b056e950>, body: {"pool": null} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:49.108162 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f22c562c-5d05-4d02-9646-150ee905932e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:49.109288 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f22c562c-5d05-4d02-9646-150ee905932e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:49.117059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f22c562c-5d05-4d02-9646-150ee905932e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:49.118083 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f22c562c-5d05-4d02-9646-150ee905932e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:49.119107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f22c562c-5d05-4d02-9646-150ee905932e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:49.119602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f22c562c-5d05-4d02-9646-150ee905932e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:49.343826 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f22c562c-5d05-4d02-9646-150ee905932e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:49.353843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f22c562c-5d05-4d02-9646-150ee905932e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:49.355397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f22c562c-5d05-4d02-9646-150ee905932e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:49.356784 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f22c562c-5d05-4d02-9646-150ee905932e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1720 microversion: 2.20 time: 0.252841 Feb 17 03:32:49.357616 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 390/784] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:49 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1720 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:49.373901 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-95a63927-319f-458c-8a86-890937ee4f95 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:49.374608 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-95a63927-319f-458c-8a86-890937ee4f95 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:49.382390 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95a63927-319f-458c-8a86-890937ee4f95 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:49.383438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95a63927-319f-458c-8a86-890937ee4f95 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:49.383713 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95a63927-319f-458c-8a86-890937ee4f95 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:49.384207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95a63927-319f-458c-8a86-890937ee4f95 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:49.634340 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-95a63927-319f-458c-8a86-890937ee4f95 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:49.660441 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-95a63927-319f-458c-8a86-890937ee4f95 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1512 microversion: 2.1 time: 0.290164 Feb 17 03:32:49.665086 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 391/785] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:49 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1512 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:50.017309 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-28123249-1e30-4d6a-9626-05c7f3a4b512 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:50.017984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-28123249-1e30-4d6a-9626-05c7f3a4b512 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:50.026422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-28123249-1e30-4d6a-9626-05c7f3a4b512 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:50.026924 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-28123249-1e30-4d6a-9626-05c7f3a4b512 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:50.027803 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-28123249-1e30-4d6a-9626-05c7f3a4b512 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:50.028293 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-28123249-1e30-4d6a-9626-05c7f3a4b512 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:50.243680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-28123249-1e30-4d6a-9626-05c7f3a4b512 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:50.253746 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-28123249-1e30-4d6a-9626-05c7f3a4b512 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1724 microversion: 2.1 time: 0.242952 Feb 17 03:32:50.254574 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 392/786] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:50 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:50.376120 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9c55228c-1e48-4472-b12a-4c215504a72e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:50.377097 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9c55228c-1e48-4472-b12a-4c215504a72e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:50.385753 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9c55228c-1e48-4472-b12a-4c215504a72e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:50.386123 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9c55228c-1e48-4472-b12a-4c215504a72e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:50.386973 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9c55228c-1e48-4472-b12a-4c215504a72e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:50.387544 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9c55228c-1e48-4472-b12a-4c215504a72e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:50.608441 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9c55228c-1e48-4472-b12a-4c215504a72e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:50.618687 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9c55228c-1e48-4472-b12a-4c215504a72e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:50.620390 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9c55228c-1e48-4472-b12a-4c215504a72e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:50.621619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9c55228c-1e48-4472-b12a-4c215504a72e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1720 microversion: 2.20 time: 0.249723 Feb 17 03:32:50.622534 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 393/787] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:50 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1720 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:32:50.679243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-eca8f448-4138-4109-a561-bb2be159e3e5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:50.680509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-eca8f448-4138-4109-a561-bb2be159e3e5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:50.689365 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eca8f448-4138-4109-a561-bb2be159e3e5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:50.689694 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eca8f448-4138-4109-a561-bb2be159e3e5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:50.690643 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eca8f448-4138-4109-a561-bb2be159e3e5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:50.691216 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eca8f448-4138-4109-a561-bb2be159e3e5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:51.065271 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-eca8f448-4138-4109-a561-bb2be159e3e5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:51.075213 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-eca8f448-4138-4109-a561-bb2be159e3e5 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1512 microversion: 2.1 time: 0.400090 Feb 17 03:32:51.075896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 394/788] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:50 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1512 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:51.271797 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f8e76907-1b21-42ff-870e-0b194c6ef272 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:51.272459 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f8e76907-1b21-42ff-870e-0b194c6ef272 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:51.280926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8e76907-1b21-42ff-870e-0b194c6ef272 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:51.281341 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8e76907-1b21-42ff-870e-0b194c6ef272 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:51.282175 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8e76907-1b21-42ff-870e-0b194c6ef272 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:51.282664 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8e76907-1b21-42ff-870e-0b194c6ef272 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:51.504215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f8e76907-1b21-42ff-870e-0b194c6ef272 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:51.514295 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f8e76907-1b21-42ff-870e-0b194c6ef272 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1724 microversion: 2.1 time: 0.246410 Feb 17 03:32:51.515004 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 395/789] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:51 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:51.536821 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-dd2a47ce-4181-4bbd-9e94-4650add4f8e3 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.481385 Feb 17 03:32:51.537612 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 395/790] 10.222.0.57 () {60 vars in 1160 bytes} [Wed Feb 17 03:32:49 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:51.549660 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-542f597b-b19b-4ada-9cd3-9a438a4ca2a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Action: 'action', calling method: .version_select at 0x7f98b11edae8>, body: {"addFloatingIp": {"address": "172.27.0.192"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:51.551121 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-542f597b-b19b-4ada-9cd3-9a438a4ca2a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:51.558980 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-542f597b-b19b-4ada-9cd3-9a438a4ca2a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:51.559487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-542f597b-b19b-4ada-9cd3-9a438a4ca2a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:51.560313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-542f597b-b19b-4ada-9cd3-9a438a4ca2a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:51.560796 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-542f597b-b19b-4ada-9cd3-9a438a4ca2a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:51.625310 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-542f597b-b19b-4ada-9cd3-9a438a4ca2a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Acquired lock "refresh_cache-ce920548-efb2-455b-a260-d9b321d73cd9" {{(pid=98104) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:32:51.641624 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-36239516-d6e3-4bb0-8571-e704dd476182 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:51.642396 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-36239516-d6e3-4bb0-8571-e704dd476182 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:51.651498 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-36239516-d6e3-4bb0-8571-e704dd476182 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:51.652088 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-36239516-d6e3-4bb0-8571-e704dd476182 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:51.652993 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-36239516-d6e3-4bb0-8571-e704dd476182 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:51.653581 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-36239516-d6e3-4bb0-8571-e704dd476182 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:51.870678 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-36239516-d6e3-4bb0-8571-e704dd476182 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:51.884042 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-36239516-d6e3-4bb0-8571-e704dd476182 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:51.885844 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-36239516-d6e3-4bb0-8571-e704dd476182 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:51.887219 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-36239516-d6e3-4bb0-8571-e704dd476182 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1720 microversion: 2.20 time: 0.249589 Feb 17 03:32:51.887947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 396/791] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:51 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1720 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:52.094893 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2f965e85-1e6a-4582-b7b6-402a76cd9db9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:52.095591 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2f965e85-1e6a-4582-b7b6-402a76cd9db9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:52.104373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2f965e85-1e6a-4582-b7b6-402a76cd9db9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:52.104879 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2f965e85-1e6a-4582-b7b6-402a76cd9db9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:52.105939 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2f965e85-1e6a-4582-b7b6-402a76cd9db9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:52.106443 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2f965e85-1e6a-4582-b7b6-402a76cd9db9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:52.427479 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2f965e85-1e6a-4582-b7b6-402a76cd9db9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:52.448351 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2f965e85-1e6a-4582-b7b6-402a76cd9db9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1512 microversion: 2.1 time: 0.358951 Feb 17 03:32:52.449226 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 397/792] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:52 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1512 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:52.533834 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f171fab2-7e3d-4659-8474-d5cc058fed7e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:52.534673 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f171fab2-7e3d-4659-8474-d5cc058fed7e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:52.544649 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f171fab2-7e3d-4659-8474-d5cc058fed7e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:52.545295 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f171fab2-7e3d-4659-8474-d5cc058fed7e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:52.546146 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f171fab2-7e3d-4659-8474-d5cc058fed7e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:52.546628 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f171fab2-7e3d-4659-8474-d5cc058fed7e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:52.890572 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f171fab2-7e3d-4659-8474-d5cc058fed7e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:52.901634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f171fab2-7e3d-4659-8474-d5cc058fed7e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1724 microversion: 2.1 time: 0.371732 Feb 17 03:32:52.902481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 398/793] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:52 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1724 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:52.908213 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-95b1e7e6-862c-4b4c-96f5-7ed640177276 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:52.908881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-95b1e7e6-862c-4b4c-96f5-7ed640177276 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:52.917481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95b1e7e6-862c-4b4c-96f5-7ed640177276 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:52.917970 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95b1e7e6-862c-4b4c-96f5-7ed640177276 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:52.919021 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95b1e7e6-862c-4b4c-96f5-7ed640177276 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:52.920169 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-95b1e7e6-862c-4b4c-96f5-7ed640177276 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:53.142972 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-95b1e7e6-862c-4b4c-96f5-7ed640177276 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:53.153661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-95b1e7e6-862c-4b4c-96f5-7ed640177276 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:53.155224 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-95b1e7e6-862c-4b4c-96f5-7ed640177276 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:53.156406 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-95b1e7e6-862c-4b4c-96f5-7ed640177276 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1720 microversion: 2.20 time: 0.252776 Feb 17 03:32:53.156961 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 399/794] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:52 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1720 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:53.466677 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7bbf4256-4ebd-4b4b-9d90-0317aaa846b1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:53.467311 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7bbf4256-4ebd-4b4b-9d90-0317aaa846b1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:53.475768 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7bbf4256-4ebd-4b4b-9d90-0317aaa846b1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:53.476289 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7bbf4256-4ebd-4b4b-9d90-0317aaa846b1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:53.477171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7bbf4256-4ebd-4b4b-9d90-0317aaa846b1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:53.477662 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7bbf4256-4ebd-4b4b-9d90-0317aaa846b1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:53.694051 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7bbf4256-4ebd-4b4b-9d90-0317aaa846b1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:53.704053 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7bbf4256-4ebd-4b4b-9d90-0317aaa846b1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1512 microversion: 2.1 time: 0.241684 Feb 17 03:32:53.704648 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 400/795] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:53 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:53.920485 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f9786db4-2408-45fb-b66a-9fc9c48093ed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:53.921279 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f9786db4-2408-45fb-b66a-9fc9c48093ed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:53.929739 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f9786db4-2408-45fb-b66a-9fc9c48093ed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:53.930642 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f9786db4-2408-45fb-b66a-9fc9c48093ed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:53.931620 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f9786db4-2408-45fb-b66a-9fc9c48093ed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:53.932342 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f9786db4-2408-45fb-b66a-9fc9c48093ed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:54.161406 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f9786db4-2408-45fb-b66a-9fc9c48093ed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:54.175357 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f9786db4-2408-45fb-b66a-9fc9c48093ed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1724 microversion: 2.1 time: 0.258814 Feb 17 03:32:54.176075 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 401/796] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:53 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:32:54.189070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8819eadb-a9b8-4e71-95cb-daf247f366e2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:54.189824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8819eadb-a9b8-4e71-95cb-daf247f366e2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:54.199528 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8819eadb-a9b8-4e71-95cb-daf247f366e2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:54.200046 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8819eadb-a9b8-4e71-95cb-daf247f366e2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:54.200910 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8819eadb-a9b8-4e71-95cb-daf247f366e2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:54.201432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8819eadb-a9b8-4e71-95cb-daf247f366e2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:54.324570 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-542f597b-b19b-4ada-9cd3-9a438a4ca2a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Building network info cache for instance {{(pid=98104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 03:32:54.450381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8819eadb-a9b8-4e71-95cb-daf247f366e2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:54.469359 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8819eadb-a9b8-4e71-95cb-daf247f366e2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:54.471559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8819eadb-a9b8-4e71-95cb-daf247f366e2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:54.472890 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8819eadb-a9b8-4e71-95cb-daf247f366e2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1720 microversion: 2.20 time: 0.295698 Feb 17 03:32:54.473933 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 402/797] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:54 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1720 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:54.480357 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-3ad7fb8c-a979-457c-92fe-2def81659bbf req-c667292f-9a6b-4797-b04a-9e6c657ec7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce920548-efb2-455b-a260-d9b321d73cd9", "tag": "ce570470-08b9-4b72-be9b-4b61e88ce552"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:54.482532 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:54.482532 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:32:54.494761 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-3ad7fb8c-a979-457c-92fe-2def81659bbf req-c667292f-9a6b-4797-b04a-9e6c657ec7b9 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:54.495372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-3ad7fb8c-a979-457c-92fe-2def81659bbf req-c667292f-9a6b-4797-b04a-9e6c657ec7b9 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:54.518926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-3ad7fb8c-a979-457c-92fe-2def81659bbf req-c667292f-9a6b-4797-b04a-9e6c657ec7b9 service nova] Creating event network-changed:ce570470-08b9-4b72-be9b-4b61e88ce552 for instance ce920548-efb2-455b-a260-d9b321d73cd9 on hv-cinder-75994 Feb 17 03:32:54.525404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-3ad7fb8c-a979-457c-92fe-2def81659bbf req-c667292f-9a6b-4797-b04a-9e6c657ec7b9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049774 Feb 17 03:32:54.526426 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 403/798] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:54.722569 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4240892a-a8c8-4ad9-b4f0-1a946af74ed1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:54.723342 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4240892a-a8c8-4ad9-b4f0-1a946af74ed1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:54.732138 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4240892a-a8c8-4ad9-b4f0-1a946af74ed1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:54.732650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4240892a-a8c8-4ad9-b4f0-1a946af74ed1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:54.733526 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4240892a-a8c8-4ad9-b4f0-1a946af74ed1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:54.734017 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4240892a-a8c8-4ad9-b4f0-1a946af74ed1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:55.011105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4240892a-a8c8-4ad9-b4f0-1a946af74ed1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:55.020953 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4240892a-a8c8-4ad9-b4f0-1a946af74ed1 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1512 microversion: 2.1 time: 0.302803 Feb 17 03:32:55.021601 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 404/799] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:54 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1512 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:55.196414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-feca674f-4923-4e6d-a8f5-fa16d66d0f99 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:55.196793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-feca674f-4923-4e6d-a8f5-fa16d66d0f99 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:55.206669 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-feca674f-4923-4e6d-a8f5-fa16d66d0f99 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:55.207362 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-feca674f-4923-4e6d-a8f5-fa16d66d0f99 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:55.208551 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-feca674f-4923-4e6d-a8f5-fa16d66d0f99 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:55.209249 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-feca674f-4923-4e6d-a8f5-fa16d66d0f99 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:55.481217 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-feca674f-4923-4e6d-a8f5-fa16d66d0f99 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:55.495402 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-feca674f-4923-4e6d-a8f5-fa16d66d0f99 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1724 microversion: 2.1 time: 0.304375 Feb 17 03:32:55.496695 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 405/800] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:55 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:55.503126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bffe442d-76ea-4f93-a6b7-8a9d921b27d1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:55.503794 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bffe442d-76ea-4f93-a6b7-8a9d921b27d1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:55.514320 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bffe442d-76ea-4f93-a6b7-8a9d921b27d1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:55.515477 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bffe442d-76ea-4f93-a6b7-8a9d921b27d1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:55.516487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bffe442d-76ea-4f93-a6b7-8a9d921b27d1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:55.516938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bffe442d-76ea-4f93-a6b7-8a9d921b27d1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:55.975000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bffe442d-76ea-4f93-a6b7-8a9d921b27d1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:55.993545 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bffe442d-76ea-4f93-a6b7-8a9d921b27d1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:55.998894 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bffe442d-76ea-4f93-a6b7-8a9d921b27d1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:56.007445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bffe442d-76ea-4f93-a6b7-8a9d921b27d1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1720 microversion: 2.20 time: 0.509206 Feb 17 03:32:56.008797 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 406/801] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:55 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1720 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:32:56.025736 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-83138046-7f0b-425e-9407-3eb6e4c728f7 req-ce4ef25a-50bf-4660-8364-6f6da951929c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fbbd236-7b97-4182-8fe1-acbc901bf34e", "name": "network-vif-unplugged", "status": "completed", "tag": "3f278c60-d4fc-48d2-a84d-a1bd008033aa"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:56.028117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:56.028117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:32:56.040757 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-83138046-7f0b-425e-9407-3eb6e4c728f7 req-ce4ef25a-50bf-4660-8364-6f6da951929c service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:56.041817 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-83138046-7f0b-425e-9407-3eb6e4c728f7 req-ce4ef25a-50bf-4660-8364-6f6da951929c service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:56.062423 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-83138046-7f0b-425e-9407-3eb6e4c728f7 req-ce4ef25a-50bf-4660-8364-6f6da951929c service nova] Creating event network-vif-unplugged:3f278c60-d4fc-48d2-a84d-a1bd008033aa for instance 4fbbd236-7b97-4182-8fe1-acbc901bf34e on hv-cinder-75994 Feb 17 03:32:56.067483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-83138046-7f0b-425e-9407-3eb6e4c728f7 req-ce4ef25a-50bf-4660-8364-6f6da951929c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045982 Feb 17 03:32:56.068250 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 407/802] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:56 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:56.075811 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-571e8e0d-ab72-4ab6-bcff-077c78d071b3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:56.076709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-571e8e0d-ab72-4ab6-bcff-077c78d071b3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:56.111725 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-571e8e0d-ab72-4ab6-bcff-077c78d071b3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:56.112599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-571e8e0d-ab72-4ab6-bcff-077c78d071b3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:56.114043 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-571e8e0d-ab72-4ab6-bcff-077c78d071b3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:56.114723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-571e8e0d-ab72-4ab6-bcff-077c78d071b3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:56.617260 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-571e8e0d-ab72-4ab6-bcff-077c78d071b3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:56.627528 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-571e8e0d-ab72-4ab6-bcff-077c78d071b3 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1512 microversion: 2.1 time: 0.558000 Feb 17 03:32:56.628782 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 408/803] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:56 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1512 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:56.634274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-77093304-9384-4ee3-a6ef-813308b4bb65 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:56.635193 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-77093304-9384-4ee3-a6ef-813308b4bb65 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:56.644122 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-77093304-9384-4ee3-a6ef-813308b4bb65 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:56.644930 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-77093304-9384-4ee3-a6ef-813308b4bb65 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:56.646036 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-77093304-9384-4ee3-a6ef-813308b4bb65 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:56.646616 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-77093304-9384-4ee3-a6ef-813308b4bb65 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:57.000394 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-77093304-9384-4ee3-a6ef-813308b4bb65 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:57.014373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-77093304-9384-4ee3-a6ef-813308b4bb65 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1724 microversion: 2.1 time: 0.383521 Feb 17 03:32:57.015727 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 409/804] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:56 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1724 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:57.028028 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-82ec7bb8-df3a-4046-b559-61fffee9142c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:57.030215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-82ec7bb8-df3a-4046-b559-61fffee9142c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:57.038406 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82ec7bb8-df3a-4046-b559-61fffee9142c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:57.039310 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82ec7bb8-df3a-4046-b559-61fffee9142c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:57.041207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82ec7bb8-df3a-4046-b559-61fffee9142c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:57.041905 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82ec7bb8-df3a-4046-b559-61fffee9142c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:57.220774 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-542f597b-b19b-4ada-9cd3-9a438a4ca2a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Updating instance_info_cache with network_info: [{"id": "ce570470-08b9-4b72-be9b-4b61e88ce552", "address": "fa:16:3e:d0:6c:b6", "network": {"id": "3cb0cdf3-e2d2-4fae-b226-b086c7cc05ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1162730446-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "09f977ccc1e54aa6bfffd127c9a4be7d", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapce570470-08", "ovs_interfaceid": "ce570470-08b9-4b72-be9b-4b61e88ce552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 03:32:57.236663 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-542f597b-b19b-4ada-9cd3-9a438a4ca2a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Releasing lock "refresh_cache-ce920548-efb2-455b-a260-d9b321d73cd9" {{(pid=98104) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:32:57.237574 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-542f597b-b19b-4ada-9cd3-9a438a4ca2a7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "POST /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9/action" status: 202 len: 0 microversion: 2.1 time: 5.691921 Feb 17 03:32:57.238224 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 396/805] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:32:51 2021] POST /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9/action => generated 0 bytes in 5693 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 03:32:57.430937 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-82ec7bb8-df3a-4046-b559-61fffee9142c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:57.449262 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-82ec7bb8-df3a-4046-b559-61fffee9142c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:57.451359 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-82ec7bb8-df3a-4046-b559-61fffee9142c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:57.452892 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-82ec7bb8-df3a-4046-b559-61fffee9142c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1741 microversion: 2.20 time: 0.429444 Feb 17 03:32:57.453726 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 410/806] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:57 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1741 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:32:57.645823 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b846176b-a35e-4c58-871a-ecc988c30448 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:57.646502 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b846176b-a35e-4c58-871a-ecc988c30448 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:57.659744 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b846176b-a35e-4c58-871a-ecc988c30448 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:57.660268 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b846176b-a35e-4c58-871a-ecc988c30448 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:57.661154 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b846176b-a35e-4c58-871a-ecc988c30448 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:57.661650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b846176b-a35e-4c58-871a-ecc988c30448 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:58.034167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8fbe1636-5adb-4566-958c-a52c74668c8c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:58.035491 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8fbe1636-5adb-4566-958c-a52c74668c8c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:58.044135 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8fbe1636-5adb-4566-958c-a52c74668c8c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:58.044978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8fbe1636-5adb-4566-958c-a52c74668c8c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:58.046084 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8fbe1636-5adb-4566-958c-a52c74668c8c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:58.046779 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8fbe1636-5adb-4566-958c-a52c74668c8c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:58.198304 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b846176b-a35e-4c58-871a-ecc988c30448 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:58.212848 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b846176b-a35e-4c58-871a-ecc988c30448 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 200 len: 1512 microversion: 2.1 time: 0.571033 Feb 17 03:32:58.217293 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 397/807] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:57 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 1512 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:58.277986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8fbe1636-5adb-4566-958c-a52c74668c8c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:58.288487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8fbe1636-5adb-4566-958c-a52c74668c8c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1724 microversion: 2.1 time: 0.258265 Feb 17 03:32:58.289096 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 411/808] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:58 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:58.454291 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-5d1bf203-41b1-4489-85f9-67d05fc21b79 req-cae125c0-9bb0-4bd1-ae7a-ba22d182e1b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fbbd236-7b97-4182-8fe1-acbc901bf34e", "name": "network-vif-deleted", "tag": "3f278c60-d4fc-48d2-a84d-a1bd008033aa"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:32:58.456065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:32:58.456065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:32:58.466171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-5d1bf203-41b1-4489-85f9-67d05fc21b79 req-cae125c0-9bb0-4bd1-ae7a-ba22d182e1b1 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:58.466832 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-5d1bf203-41b1-4489-85f9-67d05fc21b79 req-cae125c0-9bb0-4bd1-ae7a-ba22d182e1b1 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:58.477337 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9735a4f5-be00-425a-a222-f705eba950f0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:58.478196 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9735a4f5-be00-425a-a222-f705eba950f0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:58.485992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9735a4f5-be00-425a-a222-f705eba950f0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:58.486572 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-5d1bf203-41b1-4489-85f9-67d05fc21b79 req-cae125c0-9bb0-4bd1-ae7a-ba22d182e1b1 service nova] Creating event network-vif-deleted:3f278c60-d4fc-48d2-a84d-a1bd008033aa for instance 4fbbd236-7b97-4182-8fe1-acbc901bf34e on hv-cinder-75994 Feb 17 03:32:58.486699 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9735a4f5-be00-425a-a222-f705eba950f0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:58.487496 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9735a4f5-be00-425a-a222-f705eba950f0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:58.488060 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9735a4f5-be00-425a-a222-f705eba950f0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:58.491689 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-5d1bf203-41b1-4489-85f9-67d05fc21b79 req-cae125c0-9bb0-4bd1-ae7a-ba22d182e1b1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041311 Feb 17 03:32:58.492335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 398/809] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:32:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:32:58.703348 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9735a4f5-be00-425a-a222-f705eba950f0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:58.712729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9735a4f5-be00-425a-a222-f705eba950f0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:58.714346 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9735a4f5-be00-425a-a222-f705eba950f0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:58.715536 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9735a4f5-be00-425a-a222-f705eba950f0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1741 microversion: 2.20 time: 0.242321 Feb 17 03:32:58.716091 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 412/810] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:58 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1741 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:32:59.233255 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-00f5d7e8-d4cd-40a0-b2b3-477befba5cf9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:59.233955 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-00f5d7e8-d4cd-40a0-b2b3-477befba5cf9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 4fbbd236-7b97-4182-8fe1-acbc901bf34e] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:59.241943 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-00f5d7e8-d4cd-40a0-b2b3-477befba5cf9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:59.243122 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-00f5d7e8-d4cd-40a0-b2b3-477befba5cf9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:59.243958 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-00f5d7e8-d4cd-40a0-b2b3-477befba5cf9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:59.244454 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-00f5d7e8-d4cd-40a0-b2b3-477befba5cf9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:59.296636 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-00f5d7e8-d4cd-40a0-b2b3-477befba5cf9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] HTTP exception thrown: Instance 4fbbd236-7b97-4182-8fe1-acbc901bf34e could not be found. Feb 17 03:32:59.297350 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-00f5d7e8-d4cd-40a0-b2b3-477befba5cf9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Returning 404 to user: Instance 4fbbd236-7b97-4182-8fe1-acbc901bf34e could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:32:59.298258 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-00f5d7e8-d4cd-40a0-b2b3-477befba5cf9 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e" status: 404 len: 111 microversion: 2.1 time: 0.069773 Feb 17 03:32:59.298860 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 399/811] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:59 2021] GET /compute/v2.1/servers/4fbbd236-7b97-4182-8fe1-acbc901bf34e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:32:59.308173 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1acd3a90-f4ac-4f30-b7b6-1393f97f12eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:59.308922 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1acd3a90-f4ac-4f30-b7b6-1393f97f12eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:59.316934 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1acd3a90-f4ac-4f30-b7b6-1393f97f12eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:59.317487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1acd3a90-f4ac-4f30-b7b6-1393f97f12eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:59.318327 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1acd3a90-f4ac-4f30-b7b6-1393f97f12eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:59.318827 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1acd3a90-f4ac-4f30-b7b6-1393f97f12eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:59.531821 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1acd3a90-f4ac-4f30-b7b6-1393f97f12eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:59.541929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1acd3a90-f4ac-4f30-b7b6-1393f97f12eb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1724 microversion: 2.1 time: 0.238692 Feb 17 03:32:59.542514 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 413/812] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:32:59 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:32:59.734836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d873c3ce-942e-471f-877e-d818654ee498 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:32:59.735502 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d873c3ce-942e-471f-877e-d818654ee498 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:32:59.743432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d873c3ce-942e-471f-877e-d818654ee498 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:59.743876 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d873c3ce-942e-471f-877e-d818654ee498 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:59.744694 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d873c3ce-942e-471f-877e-d818654ee498 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:32:59.745209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d873c3ce-942e-471f-877e-d818654ee498 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:32:59.955305 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d873c3ce-942e-471f-877e-d818654ee498 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:59.964995 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d873c3ce-942e-471f-877e-d818654ee498 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:59.966614 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d873c3ce-942e-471f-877e-d818654ee498 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:32:59.967783 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d873c3ce-942e-471f-877e-d818654ee498 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1741 microversion: 2.20 time: 0.237090 Feb 17 03:32:59.968365 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 400/813] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:32:59 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1741 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:00.560950 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-207aaa45-cb64-4707-a238-dda7247c84c6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:00.561729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-207aaa45-cb64-4707-a238-dda7247c84c6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:00.569901 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-207aaa45-cb64-4707-a238-dda7247c84c6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:00.571233 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-207aaa45-cb64-4707-a238-dda7247c84c6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:00.572083 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-207aaa45-cb64-4707-a238-dda7247c84c6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:00.572577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-207aaa45-cb64-4707-a238-dda7247c84c6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:00.782269 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-207aaa45-cb64-4707-a238-dda7247c84c6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:00.792368 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-207aaa45-cb64-4707-a238-dda7247c84c6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1724 microversion: 2.1 time: 0.235736 Feb 17 03:33:00.792959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 414/814] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:00 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:33:00.987232 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bb8c0681-6200-430d-9e44-b6a8fce3970c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:00.987827 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bb8c0681-6200-430d-9e44-b6a8fce3970c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:00.995811 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb8c0681-6200-430d-9e44-b6a8fce3970c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:00.996356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb8c0681-6200-430d-9e44-b6a8fce3970c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:00.997227 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb8c0681-6200-430d-9e44-b6a8fce3970c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:00.997720 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb8c0681-6200-430d-9e44-b6a8fce3970c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:01.208021 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bb8c0681-6200-430d-9e44-b6a8fce3970c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:01.217860 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bb8c0681-6200-430d-9e44-b6a8fce3970c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:01.219436 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bb8c0681-6200-430d-9e44-b6a8fce3970c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:01.220590 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bb8c0681-6200-430d-9e44-b6a8fce3970c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1741 microversion: 2.20 time: 0.237516 Feb 17 03:33:01.221187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 401/815] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:00 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1741 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:01.646771 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bb291d63-c2ae-4770-9850-33360d81b5dc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:01.647319 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bb291d63-c2ae-4770-9850-33360d81b5dc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:01.655990 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb291d63-c2ae-4770-9850-33360d81b5dc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:01.656490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb291d63-c2ae-4770-9850-33360d81b5dc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:01.657367 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb291d63-c2ae-4770-9850-33360d81b5dc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:01.657954 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bb291d63-c2ae-4770-9850-33360d81b5dc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:01.728414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bb291d63-c2ae-4770-9850-33360d81b5dc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Going to try to terminate instance {{(pid=98103) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:33:01.813264 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-433d64ab-29a8-4823-862e-8f1bf919ba8a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:01.813932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-433d64ab-29a8-4823-862e-8f1bf919ba8a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:01.822363 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-433d64ab-29a8-4823-862e-8f1bf919ba8a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:01.822871 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-433d64ab-29a8-4823-862e-8f1bf919ba8a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:01.823710 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-433d64ab-29a8-4823-862e-8f1bf919ba8a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:01.824201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-433d64ab-29a8-4823-862e-8f1bf919ba8a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:01.861429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bb291d63-c2ae-4770-9850-33360d81b5dc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "DELETE /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 204 len: 0 microversion: 2.1 time: 0.217992 Feb 17 03:33:01.876145 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 415/816] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:33:01 2021] DELETE /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:33:01.882237 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4464d571-11b1-40cc-9780-2782e37cb538 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:01.883062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4464d571-11b1-40cc-9780-2782e37cb538 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:01.890905 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4464d571-11b1-40cc-9780-2782e37cb538 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:01.891413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4464d571-11b1-40cc-9780-2782e37cb538 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:01.892267 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4464d571-11b1-40cc-9780-2782e37cb538 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:01.892760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4464d571-11b1-40cc-9780-2782e37cb538 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:02.048434 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-433d64ab-29a8-4823-862e-8f1bf919ba8a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:02.058294 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-433d64ab-29a8-4823-862e-8f1bf919ba8a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1724 microversion: 2.1 time: 0.251718 Feb 17 03:33:02.058887 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 402/817] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:01 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:33:02.124197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4464d571-11b1-40cc-9780-2782e37cb538 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:02.133681 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4464d571-11b1-40cc-9780-2782e37cb538 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1513 microversion: 2.1 time: 0.255345 Feb 17 03:33:02.134280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 416/818] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:01 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:33:02.240807 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7e88a271-80e1-4346-93a6-2861a0ffaeef tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:02.241534 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7e88a271-80e1-4346-93a6-2861a0ffaeef tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:02.249374 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7e88a271-80e1-4346-93a6-2861a0ffaeef tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:02.249893 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7e88a271-80e1-4346-93a6-2861a0ffaeef tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:02.250732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7e88a271-80e1-4346-93a6-2861a0ffaeef tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:02.251231 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7e88a271-80e1-4346-93a6-2861a0ffaeef tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:02.680137 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7e88a271-80e1-4346-93a6-2861a0ffaeef tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:02.689672 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7e88a271-80e1-4346-93a6-2861a0ffaeef tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:02.691260 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7e88a271-80e1-4346-93a6-2861a0ffaeef tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:02.692447 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7e88a271-80e1-4346-93a6-2861a0ffaeef tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1741 microversion: 2.20 time: 0.455809 Feb 17 03:33:02.693078 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 403/819] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:02 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1741 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:03.076438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-59e9f07f-eb68-43a5-8c2b-d39c69f32d59 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:03.077215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-59e9f07f-eb68-43a5-8c2b-d39c69f32d59 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:03.085304 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-59e9f07f-eb68-43a5-8c2b-d39c69f32d59 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:03.085815 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-59e9f07f-eb68-43a5-8c2b-d39c69f32d59 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:03.086659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-59e9f07f-eb68-43a5-8c2b-d39c69f32d59 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:03.087152 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-59e9f07f-eb68-43a5-8c2b-d39c69f32d59 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:03.151320 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5438b392-44d1-4657-a5b7-040ec6da2d7a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:03.152074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5438b392-44d1-4657-a5b7-040ec6da2d7a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:03.159885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5438b392-44d1-4657-a5b7-040ec6da2d7a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:03.160383 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5438b392-44d1-4657-a5b7-040ec6da2d7a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:03.161248 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5438b392-44d1-4657-a5b7-040ec6da2d7a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:03.161739 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5438b392-44d1-4657-a5b7-040ec6da2d7a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:03.402236 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5438b392-44d1-4657-a5b7-040ec6da2d7a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:03.411491 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5438b392-44d1-4657-a5b7-040ec6da2d7a tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1513 microversion: 2.1 time: 0.264223 Feb 17 03:33:03.412102 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 404/820] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:03 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1513 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:33:03.521923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-59e9f07f-eb68-43a5-8c2b-d39c69f32d59 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:03.531784 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-59e9f07f-eb68-43a5-8c2b-d39c69f32d59 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1724 microversion: 2.1 time: 0.459379 Feb 17 03:33:03.532377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 417/821] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:03 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1724 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:33:03.712655 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-66560aa5-81ba-4672-b072-dfa964ee85d2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:03.713305 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-66560aa5-81ba-4672-b072-dfa964ee85d2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:03.721257 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-66560aa5-81ba-4672-b072-dfa964ee85d2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:03.721769 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-66560aa5-81ba-4672-b072-dfa964ee85d2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:03.722607 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-66560aa5-81ba-4672-b072-dfa964ee85d2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:03.723106 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-66560aa5-81ba-4672-b072-dfa964ee85d2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:03.933856 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-66560aa5-81ba-4672-b072-dfa964ee85d2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:03.943250 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-66560aa5-81ba-4672-b072-dfa964ee85d2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:03.944843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-66560aa5-81ba-4672-b072-dfa964ee85d2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:03.946906 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-66560aa5-81ba-4672-b072-dfa964ee85d2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1741 microversion: 2.20 time: 0.239057 Feb 17 03:33:03.947483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 405/822] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:03 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1741 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:04.430982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0320deb9-6091-4a0a-a39c-c3820d63aafc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:04.431669 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0320deb9-6091-4a0a-a39c-c3820d63aafc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:04.439573 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0320deb9-6091-4a0a-a39c-c3820d63aafc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:04.440047 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0320deb9-6091-4a0a-a39c-c3820d63aafc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:04.440877 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0320deb9-6091-4a0a-a39c-c3820d63aafc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:04.441456 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0320deb9-6091-4a0a-a39c-c3820d63aafc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:04.550496 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-187b58bc-a260-4787-b0e0-65c6555ebf5a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:04.551213 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-187b58bc-a260-4787-b0e0-65c6555ebf5a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:04.559925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-187b58bc-a260-4787-b0e0-65c6555ebf5a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:04.560429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-187b58bc-a260-4787-b0e0-65c6555ebf5a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:04.561336 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-187b58bc-a260-4787-b0e0-65c6555ebf5a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:04.561812 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-187b58bc-a260-4787-b0e0-65c6555ebf5a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:04.653909 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0320deb9-6091-4a0a-a39c-c3820d63aafc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:04.662671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0320deb9-6091-4a0a-a39c-c3820d63aafc tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1513 microversion: 2.1 time: 0.236382 Feb 17 03:33:04.663258 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 418/823] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:04 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:33:04.774912 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-187b58bc-a260-4787-b0e0-65c6555ebf5a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:04.784273 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-187b58bc-a260-4787-b0e0-65c6555ebf5a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1724 microversion: 2.1 time: 0.237824 Feb 17 03:33:04.784862 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 406/824] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:04 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:33:04.966855 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a5053ceb-b921-4db3-b46c-faec70d94c67 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:04.967522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a5053ceb-b921-4db3-b46c-faec70d94c67 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:04.976274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5053ceb-b921-4db3-b46c-faec70d94c67 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:04.977336 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5053ceb-b921-4db3-b46c-faec70d94c67 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:04.978181 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5053ceb-b921-4db3-b46c-faec70d94c67 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:04.978667 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5053ceb-b921-4db3-b46c-faec70d94c67 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:05.185545 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a5053ceb-b921-4db3-b46c-faec70d94c67 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:05.195026 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a5053ceb-b921-4db3-b46c-faec70d94c67 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:05.197703 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a5053ceb-b921-4db3-b46c-faec70d94c67 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:05.198883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a5053ceb-b921-4db3-b46c-faec70d94c67 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1741 microversion: 2.20 time: 0.236298 Feb 17 03:33:05.199463 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 419/825] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:04 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1741 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:05.681532 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0caa6c9c-be4f-4e80-a556-654459c42da8 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:05.682199 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0caa6c9c-be4f-4e80-a556-654459c42da8 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:05.690079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0caa6c9c-be4f-4e80-a556-654459c42da8 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:05.690588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0caa6c9c-be4f-4e80-a556-654459c42da8 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:05.691434 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0caa6c9c-be4f-4e80-a556-654459c42da8 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:05.691920 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0caa6c9c-be4f-4e80-a556-654459c42da8 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:05.803831 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e5ad4764-7649-4236-b385-168c480125ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:05.804417 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e5ad4764-7649-4236-b385-168c480125ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:05.813070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5ad4764-7649-4236-b385-168c480125ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:05.813585 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5ad4764-7649-4236-b385-168c480125ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:05.814652 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5ad4764-7649-4236-b385-168c480125ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:05.815141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5ad4764-7649-4236-b385-168c480125ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:05.912026 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0caa6c9c-be4f-4e80-a556-654459c42da8 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:05.921415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0caa6c9c-be4f-4e80-a556-654459c42da8 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1513 microversion: 2.1 time: 0.244613 Feb 17 03:33:05.922017 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 407/826] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:05 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:33:06.038084 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e5ad4764-7649-4236-b385-168c480125ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:06.048035 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e5ad4764-7649-4236-b385-168c480125ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1724 microversion: 2.1 time: 0.248488 Feb 17 03:33:06.048630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 420/827] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:05 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:33:06.218455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-66f7d9cd-65d4-45c7-a489-b62fb9cb7f05 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:06.219118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-66f7d9cd-65d4-45c7-a489-b62fb9cb7f05 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:06.227610 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-66f7d9cd-65d4-45c7-a489-b62fb9cb7f05 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:06.228113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-66f7d9cd-65d4-45c7-a489-b62fb9cb7f05 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:06.228961 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-66f7d9cd-65d4-45c7-a489-b62fb9cb7f05 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:06.229493 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-66f7d9cd-65d4-45c7-a489-b62fb9cb7f05 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:06.447966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-66f7d9cd-65d4-45c7-a489-b62fb9cb7f05 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:06.457567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-66f7d9cd-65d4-45c7-a489-b62fb9cb7f05 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:06.459163 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-66f7d9cd-65d4-45c7-a489-b62fb9cb7f05 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:06.460377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-66f7d9cd-65d4-45c7-a489-b62fb9cb7f05 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1741 microversion: 2.20 time: 0.246010 Feb 17 03:33:06.461465 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 408/828] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:06 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1741 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:06.942150 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ebce0153-9ede-46a4-bd04-41d105bf262b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:06.942824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ebce0153-9ede-46a4-bd04-41d105bf262b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:06.953265 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ebce0153-9ede-46a4-bd04-41d105bf262b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:06.953770 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ebce0153-9ede-46a4-bd04-41d105bf262b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:06.954611 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ebce0153-9ede-46a4-bd04-41d105bf262b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:06.955095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ebce0153-9ede-46a4-bd04-41d105bf262b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:07.067252 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cbcfbd45-6b73-4854-b4dc-bf42e9b7128e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:07.067931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cbcfbd45-6b73-4854-b4dc-bf42e9b7128e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:07.083051 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cbcfbd45-6b73-4854-b4dc-bf42e9b7128e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:07.083567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cbcfbd45-6b73-4854-b4dc-bf42e9b7128e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:07.084425 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cbcfbd45-6b73-4854-b4dc-bf42e9b7128e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:07.084923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cbcfbd45-6b73-4854-b4dc-bf42e9b7128e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:07.319240 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ebce0153-9ede-46a4-bd04-41d105bf262b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:07.332263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ebce0153-9ede-46a4-bd04-41d105bf262b tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1513 microversion: 2.1 time: 0.395073 Feb 17 03:33:07.333021 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 421/829] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:06 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1513 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:33:07.480645 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-938aaf9f-6dd3-4719-86d9-991431f3b47a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:07.481350 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-938aaf9f-6dd3-4719-86d9-991431f3b47a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:07.506896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-938aaf9f-6dd3-4719-86d9-991431f3b47a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:07.507425 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-938aaf9f-6dd3-4719-86d9-991431f3b47a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:07.508350 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-938aaf9f-6dd3-4719-86d9-991431f3b47a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:07.508836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-938aaf9f-6dd3-4719-86d9-991431f3b47a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:07.802767 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-cbcfbd45-6b73-4854-b4dc-bf42e9b7128e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:07.815825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cbcfbd45-6b73-4854-b4dc-bf42e9b7128e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1724 microversion: 2.1 time: 0.752732 Feb 17 03:33:07.816441 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 409/830] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:07 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1724 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:33:07.973950 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-938aaf9f-6dd3-4719-86d9-991431f3b47a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:07.984759 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-938aaf9f-6dd3-4719-86d9-991431f3b47a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:07.986736 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-938aaf9f-6dd3-4719-86d9-991431f3b47a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:07.988106 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-938aaf9f-6dd3-4719-86d9-991431f3b47a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1736 microversion: 2.20 time: 0.511900 Feb 17 03:33:07.989143 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 422/831] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:07 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1736 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:08.351738 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-499b84b3-b149-4de2-8bdb-795f5c8d10b0 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:08.352719 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-499b84b3-b149-4de2-8bdb-795f5c8d10b0 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:08.367379 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-499b84b3-b149-4de2-8bdb-795f5c8d10b0 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:08.369899 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-499b84b3-b149-4de2-8bdb-795f5c8d10b0 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:08.371347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-499b84b3-b149-4de2-8bdb-795f5c8d10b0 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:08.373217 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-499b84b3-b149-4de2-8bdb-795f5c8d10b0 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:08.576352 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-499b84b3-b149-4de2-8bdb-795f5c8d10b0 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9f8d95ac0a4a4bb6aad0bbc963d08d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ae341c7001465897265b1c5eda9767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:08.591154 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-499b84b3-b149-4de2-8bdb-795f5c8d10b0 tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 200 len: 1471 microversion: 2.1 time: 0.244213 Feb 17 03:33:08.591772 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 410/832] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:08 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:33:08.643904 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-dd4bf1c4-b513-4210-b85b-11349f355665 req-9eafc39d-16e9-4f10-9a96-8155ea886b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05b5b64f-7a56-4bd2-97ed-2e54c9e65a96", "name": "network-vif-deleted", "tag": "a22a3785-c250-4a30-9d0e-f779f4acfbdd"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:08.645946 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:33:08.645946 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:33:08.675805 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-dd4bf1c4-b513-4210-b85b-11349f355665 req-9eafc39d-16e9-4f10-9a96-8155ea886b42 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:08.676307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-dd4bf1c4-b513-4210-b85b-11349f355665 req-9eafc39d-16e9-4f10-9a96-8155ea886b42 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:08.708496 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-dd4bf1c4-b513-4210-b85b-11349f355665 req-9eafc39d-16e9-4f10-9a96-8155ea886b42 service nova] Creating event network-vif-deleted:a22a3785-c250-4a30-9d0e-f779f4acfbdd for instance 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 on hv-cinder-75994 Feb 17 03:33:08.719100 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-dd4bf1c4-b513-4210-b85b-11349f355665 req-9eafc39d-16e9-4f10-9a96-8155ea886b42 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079043 Feb 17 03:33:08.720023 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 423/833] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:33:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:33:08.840120 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7619dc25-7617-4dc3-92c0-a7bc93a3f1c2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:08.843384 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7619dc25-7617-4dc3-92c0-a7bc93a3f1c2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:08.878038 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7619dc25-7617-4dc3-92c0-a7bc93a3f1c2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:08.878862 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7619dc25-7617-4dc3-92c0-a7bc93a3f1c2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:08.894932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7619dc25-7617-4dc3-92c0-a7bc93a3f1c2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:08.895779 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7619dc25-7617-4dc3-92c0-a7bc93a3f1c2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:09.010236 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e699b45d-9b47-4eab-bec8-2b1112b64399 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:09.012519 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e699b45d-9b47-4eab-bec8-2b1112b64399 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:09.027304 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e699b45d-9b47-4eab-bec8-2b1112b64399 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:09.027694 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e699b45d-9b47-4eab-bec8-2b1112b64399 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:09.031314 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e699b45d-9b47-4eab-bec8-2b1112b64399 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:09.031849 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e699b45d-9b47-4eab-bec8-2b1112b64399 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:09.371725 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7619dc25-7617-4dc3-92c0-a7bc93a3f1c2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:09.386706 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7619dc25-7617-4dc3-92c0-a7bc93a3f1c2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1724 microversion: 2.1 time: 0.554652 Feb 17 03:33:09.403563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 411/834] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:08 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1724 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:33:09.608680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d3a4e93f-e785-40f5-aa1b-54463ab1a49f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:09.609609 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d3a4e93f-e785-40f5-aa1b-54463ab1a49f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] [instance: 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:09.618261 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d3a4e93f-e785-40f5-aa1b-54463ab1a49f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:09.619061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d3a4e93f-e785-40f5-aa1b-54463ab1a49f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:09.620160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d3a4e93f-e785-40f5-aa1b-54463ab1a49f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:09.620868 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d3a4e93f-e785-40f5-aa1b-54463ab1a49f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:09.631430 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e699b45d-9b47-4eab-bec8-2b1112b64399 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:09.641914 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e699b45d-9b47-4eab-bec8-2b1112b64399 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:09.643621 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e699b45d-9b47-4eab-bec8-2b1112b64399 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:09.644806 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e699b45d-9b47-4eab-bec8-2b1112b64399 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1736 microversion: 2.20 time: 0.640104 Feb 17 03:33:09.645449 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 424/835] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:09 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1736 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:09.682254 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-d3a4e93f-e785-40f5-aa1b-54463ab1a49f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] HTTP exception thrown: Instance 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 could not be found. Feb 17 03:33:09.684086 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d3a4e93f-e785-40f5-aa1b-54463ab1a49f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] Returning 404 to user: Instance 05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:33:09.685039 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d3a4e93f-e785-40f5-aa1b-54463ab1a49f tempest-AttachVolumeNegativeTest-1050366362 tempest-AttachVolumeNegativeTest-1050366362-project] 10.222.0.57 "GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96" status: 404 len: 111 microversion: 2.1 time: 0.080584 Feb 17 03:33:09.685690 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 412/836] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:09 2021] GET /compute/v2.1/servers/05b5b64f-7a56-4bd2-97ed-2e54c9e65a96 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 03:33:10.403997 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-54015977-3060-4861-bc8b-db1dad4bbbb2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:10.404651 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-54015977-3060-4861-bc8b-db1dad4bbbb2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:10.420915 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54015977-3060-4861-bc8b-db1dad4bbbb2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:10.421745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54015977-3060-4861-bc8b-db1dad4bbbb2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:10.422608 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54015977-3060-4861-bc8b-db1dad4bbbb2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:10.423099 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54015977-3060-4861-bc8b-db1dad4bbbb2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:10.668482 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b8a1a6dd-6076-4dde-a194-2c1d4f18b0c9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:10.669223 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b8a1a6dd-6076-4dde-a194-2c1d4f18b0c9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:10.687997 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b8a1a6dd-6076-4dde-a194-2c1d4f18b0c9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:10.688843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b8a1a6dd-6076-4dde-a194-2c1d4f18b0c9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:10.689674 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b8a1a6dd-6076-4dde-a194-2c1d4f18b0c9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:10.690054 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b8a1a6dd-6076-4dde-a194-2c1d4f18b0c9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:10.806931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-54015977-3060-4861-bc8b-db1dad4bbbb2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:10.822820 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-54015977-3060-4861-bc8b-db1dad4bbbb2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1701 microversion: 2.1 time: 0.422840 Feb 17 03:33:10.826556 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 425/837] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:10 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1701 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:33:10.843317 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-99d19e78-142f-4eaa-8bfc-5da34ff6a771 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:10.855974 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-99d19e78-142f-4eaa-8bfc-5da34ff6a771 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:10.859203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-99d19e78-142f-4eaa-8bfc-5da34ff6a771 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:10.984004 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-99d19e78-142f-4eaa-8bfc-5da34ff6a771 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Going to try to start instance {{(pid=98103) start /opt/stack/nova/nova/compute/api.py:2603}} Feb 17 03:33:11.090713 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-99d19e78-142f-4eaa-8bfc-5da34ff6a771 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 202 len: 0 microversion: 2.1 time: 0.250872 Feb 17 03:33:11.092560 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 426/838] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:33:10 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:33:11.104481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d29a65c9-a57e-494b-8c72-d4b1d76a8eb5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:11.106968 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d29a65c9-a57e-494b-8c72-d4b1d76a8eb5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:11.139150 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d29a65c9-a57e-494b-8c72-d4b1d76a8eb5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:11.145463 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d29a65c9-a57e-494b-8c72-d4b1d76a8eb5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:11.147704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d29a65c9-a57e-494b-8c72-d4b1d76a8eb5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:11.152360 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d29a65c9-a57e-494b-8c72-d4b1d76a8eb5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:11.152548 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b8a1a6dd-6076-4dde-a194-2c1d4f18b0c9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:11.166495 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b8a1a6dd-6076-4dde-a194-2c1d4f18b0c9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:11.168313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b8a1a6dd-6076-4dde-a194-2c1d4f18b0c9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:11.169589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b8a1a6dd-6076-4dde-a194-2c1d4f18b0c9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1736 microversion: 2.20 time: 0.509086 Feb 17 03:33:11.170365 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 413/839] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:10 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1736 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:11.578329 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d29a65c9-a57e-494b-8c72-d4b1d76a8eb5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:11.593825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d29a65c9-a57e-494b-8c72-d4b1d76a8eb5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1710 microversion: 2.1 time: 0.494107 Feb 17 03:33:11.594693 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 427/840] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:11 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1710 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:33:12.189903 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-84da73df-33c8-4c5c-bacb-bc5e48f460a8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:12.190841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-84da73df-33c8-4c5c-bacb-bc5e48f460a8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:12.223996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-84da73df-33c8-4c5c-bacb-bc5e48f460a8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:12.224506 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-84da73df-33c8-4c5c-bacb-bc5e48f460a8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:12.231681 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-84da73df-33c8-4c5c-bacb-bc5e48f460a8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:12.232230 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-84da73df-33c8-4c5c-bacb-bc5e48f460a8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:12.612615 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-84da73df-33c8-4c5c-bacb-bc5e48f460a8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:12.613520 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b5707b8b-e36b-41c4-b176-84386a9806d9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:12.614195 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b5707b8b-e36b-41c4-b176-84386a9806d9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:12.623823 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-84da73df-33c8-4c5c-bacb-bc5e48f460a8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:12.625716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-84da73df-33c8-4c5c-bacb-bc5e48f460a8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:12.627033 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-84da73df-33c8-4c5c-bacb-bc5e48f460a8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1736 microversion: 2.20 time: 0.441156 Feb 17 03:33:12.627766 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 414/841] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:12 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1736 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:12.636836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b5707b8b-e36b-41c4-b176-84386a9806d9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:12.637388 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b5707b8b-e36b-41c4-b176-84386a9806d9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:12.638265 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b5707b8b-e36b-41c4-b176-84386a9806d9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:12.638767 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b5707b8b-e36b-41c4-b176-84386a9806d9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:13.007072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b5707b8b-e36b-41c4-b176-84386a9806d9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:13.019933 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b5707b8b-e36b-41c4-b176-84386a9806d9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1710 microversion: 2.1 time: 0.410177 Feb 17 03:33:13.020682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 428/842] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:12 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1710 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:33:13.648712 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-90c1a945-d124-47c6-bf80-d81db3745b93 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:13.649313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-90c1a945-d124-47c6-bf80-d81db3745b93 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:13.660667 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90c1a945-d124-47c6-bf80-d81db3745b93 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:13.661184 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90c1a945-d124-47c6-bf80-d81db3745b93 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:13.671921 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90c1a945-d124-47c6-bf80-d81db3745b93 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:13.672813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90c1a945-d124-47c6-bf80-d81db3745b93 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:14.040233 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0cf9c0f6-4516-4a59-a075-ea53a0a9924e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:14.040915 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0cf9c0f6-4516-4a59-a075-ea53a0a9924e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:14.052287 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0cf9c0f6-4516-4a59-a075-ea53a0a9924e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:14.052794 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0cf9c0f6-4516-4a59-a075-ea53a0a9924e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:14.053842 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0cf9c0f6-4516-4a59-a075-ea53a0a9924e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:14.062118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0cf9c0f6-4516-4a59-a075-ea53a0a9924e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:14.085567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-90c1a945-d124-47c6-bf80-d81db3745b93 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:14.105113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-90c1a945-d124-47c6-bf80-d81db3745b93 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:14.108059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-90c1a945-d124-47c6-bf80-d81db3745b93 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:14.110196 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-90c1a945-d124-47c6-bf80-d81db3745b93 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1736 microversion: 2.20 time: 0.465957 Feb 17 03:33:14.110947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 415/843] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:13 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1736 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:14.387133 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0cf9c0f6-4516-4a59-a075-ea53a0a9924e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:14.402346 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0cf9c0f6-4516-4a59-a075-ea53a0a9924e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1714 microversion: 2.1 time: 0.367028 Feb 17 03:33:14.418021 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 429/844] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:33:14 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1714 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:33:15.131991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-883dd663-1732-4d10-982f-d6e637d01632 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:15.132719 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-883dd663-1732-4d10-982f-d6e637d01632 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:15.142781 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-883dd663-1732-4d10-982f-d6e637d01632 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:15.143844 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-883dd663-1732-4d10-982f-d6e637d01632 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:15.144898 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-883dd663-1732-4d10-982f-d6e637d01632 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:15.145497 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-883dd663-1732-4d10-982f-d6e637d01632 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:15.377065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-883dd663-1732-4d10-982f-d6e637d01632 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:15.388660 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-883dd663-1732-4d10-982f-d6e637d01632 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:15.390622 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-883dd663-1732-4d10-982f-d6e637d01632 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:15.392112 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-883dd663-1732-4d10-982f-d6e637d01632 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1736 microversion: 2.20 time: 0.264196 Feb 17 03:33:15.392941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 416/845] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:15 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1736 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:16.414290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-44669840-9265-46c4-a758-c8b4b5edb036 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:16.415000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-44669840-9265-46c4-a758-c8b4b5edb036 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:16.426708 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-44669840-9265-46c4-a758-c8b4b5edb036 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:16.427461 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-44669840-9265-46c4-a758-c8b4b5edb036 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:16.428658 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-44669840-9265-46c4-a758-c8b4b5edb036 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:16.429203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-44669840-9265-46c4-a758-c8b4b5edb036 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:16.673325 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-44669840-9265-46c4-a758-c8b4b5edb036 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:16.686209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-44669840-9265-46c4-a758-c8b4b5edb036 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:16.688065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-44669840-9265-46c4-a758-c8b4b5edb036 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:16.689566 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-44669840-9265-46c4-a758-c8b4b5edb036 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1736 microversion: 2.20 time: 0.280313 Feb 17 03:33:16.690488 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 430/846] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:16 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1736 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:17.300685 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-899be875-052d-4627-9889-8e219b915747 tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] Calling method '.version_select at 0x7f98b0246400>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:17.420577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-899be875-052d-4627-9889-8e219b915747 tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/b78a600a-cd7a-4dc7-bfc2-afa907c514e1" status: 200 len: 351 microversion: 2.1 time: 0.123798 Feb 17 03:33:17.421186 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 417/847] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Feb 17 03:33:17 2021] GET /compute/v2.1/os-volumes/b78a600a-cd7a-4dc7-bfc2-afa907c514e1 => generated 351 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:33:17.711057 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c19d0ab2-c578-4380-9745-3adc708fcb13 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:17.713008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c19d0ab2-c578-4380-9745-3adc708fcb13 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:17.727517 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c19d0ab2-c578-4380-9745-3adc708fcb13 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:17.728989 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c19d0ab2-c578-4380-9745-3adc708fcb13 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:17.731852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c19d0ab2-c578-4380-9745-3adc708fcb13 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:17.737187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c19d0ab2-c578-4380-9745-3adc708fcb13 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:18.044056 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c19d0ab2-c578-4380-9745-3adc708fcb13 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:18.056696 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c19d0ab2-c578-4380-9745-3adc708fcb13 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:18.058880 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c19d0ab2-c578-4380-9745-3adc708fcb13 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:18.060271 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c19d0ab2-c578-4380-9745-3adc708fcb13 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1736 microversion: 2.20 time: 0.353530 Feb 17 03:33:18.061209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 431/848] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:17 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1736 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:19.083451 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4ad4360f-f1c5-48ff-a784-12a92942e615 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:19.084136 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4ad4360f-f1c5-48ff-a784-12a92942e615 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:19.093899 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ad4360f-f1c5-48ff-a784-12a92942e615 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:19.094407 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ad4360f-f1c5-48ff-a784-12a92942e615 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:19.095272 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ad4360f-f1c5-48ff-a784-12a92942e615 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:19.095764 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ad4360f-f1c5-48ff-a784-12a92942e615 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:19.323378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6981a287-dc11-4de2-acc2-57b573b109b6 tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] Calling method '.version_select at 0x7f98b01a2b70>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:19.360274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4ad4360f-f1c5-48ff-a784-12a92942e615 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:19.375313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4ad4360f-f1c5-48ff-a784-12a92942e615 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:19.376892 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4ad4360f-f1c5-48ff-a784-12a92942e615 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:19.378435 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4ad4360f-f1c5-48ff-a784-12a92942e615 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1736 microversion: 2.20 time: 0.299236 Feb 17 03:33:19.379029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 418/849] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:19 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1736 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:19.485990 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6981a287-dc11-4de2-acc2-57b573b109b6 tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/61e14553-4afd-42e6-8107-a8d5e2ffcf92" status: 200 len: 351 microversion: 2.1 time: 0.167077 Feb 17 03:33:19.486699 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 432/850] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Feb 17 03:33:19 2021] GET /compute/v2.1/os-volumes/61e14553-4afd-42e6-8107-a8d5e2ffcf92 => generated 351 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:33:20.398249 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-611777ec-7bad-45ec-b7f7-2d462d59b823 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:20.399406 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-611777ec-7bad-45ec-b7f7-2d462d59b823 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:20.407300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-611777ec-7bad-45ec-b7f7-2d462d59b823 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:20.407814 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-611777ec-7bad-45ec-b7f7-2d462d59b823 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:20.408643 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-611777ec-7bad-45ec-b7f7-2d462d59b823 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:20.409160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-611777ec-7bad-45ec-b7f7-2d462d59b823 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:20.628599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-611777ec-7bad-45ec-b7f7-2d462d59b823 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:20.638583 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-611777ec-7bad-45ec-b7f7-2d462d59b823 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:20.640169 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-611777ec-7bad-45ec-b7f7-2d462d59b823 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:20.641430 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-611777ec-7bad-45ec-b7f7-2d462d59b823 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1736 microversion: 2.20 time: 0.247408 Feb 17 03:33:20.642057 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 419/851] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:20 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:21.164356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d0e6b29c-f03a-4839-bbb6-b52738da9fcf tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] Calling method '.version_select at 0x7f98b01a2c80>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:21.279698 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d0e6b29c-f03a-4839-bbb6-b52738da9fcf tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/4cb85881-a8a4-44be-85ff-c836ec3ebd41" status: 200 len: 350 microversion: 2.1 time: 0.119526 Feb 17 03:33:21.280581 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 433/852] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Feb 17 03:33:21 2021] GET /compute/v2.1/os-volumes/4cb85881-a8a4-44be-85ff-c836ec3ebd41 => generated 350 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:33:21.295880 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-252ab567-4229-4ec7-a75a-db29e7b34946 tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] Calling method '.version_select at 0x7f98aaff71e0>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:21.444306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-252ab567-4229-4ec7-a75a-db29e7b34946 tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.153289 Feb 17 03:33:21.445730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 420/853] 10.222.0.57 () {58 vars in 1124 bytes} [Wed Feb 17 03:33:21 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:33:21.465356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-66ce1c48-5754-4d44-a7bb-55a8c5443afe tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] Calling method '.version_select at 0x7f98b4532048>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:21.565462 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-66ce1c48-5754-4d44-a7bb-55a8c5443afe tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.105436 Feb 17 03:33:21.566342 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 434/854] 10.222.0.57 () {58 vars in 1139 bytes} [Wed Feb 17 03:33:21 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:33:21.580959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e015f70e-d489-4b9e-95bd-7d77c5a9d539 tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] Calling method '.version_select at 0x7f98b0246d08>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:21.661628 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-313ba7f2-bc55-4a16-a48a-a2f9c637bad1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:21.662284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-313ba7f2-bc55-4a16-a48a-a2f9c637bad1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:21.671070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-313ba7f2-bc55-4a16-a48a-a2f9c637bad1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:21.672188 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-313ba7f2-bc55-4a16-a48a-a2f9c637bad1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:21.673559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-313ba7f2-bc55-4a16-a48a-a2f9c637bad1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:21.674260 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-313ba7f2-bc55-4a16-a48a-a2f9c637bad1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:21.700933 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e015f70e-d489-4b9e-95bd-7d77c5a9d539 tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.123958 Feb 17 03:33:21.701704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 421/855] 10.222.0.57 () {58 vars in 1124 bytes} [Wed Feb 17 03:33:21 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:33:21.714455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-afbb46af-d1b4-4b65-93eb-b163ba3a07cf tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] Calling method '.version_select at 0x7f98aaff7488>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:21.812598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-afbb46af-d1b4-4b65-93eb-b163ba3a07cf tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.102557 Feb 17 03:33:21.813543 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 422/856] 10.222.0.57 () {58 vars in 1157 bytes} [Wed Feb 17 03:33:21 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:33:21.827055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e2a291fb-76fd-4ced-b89f-4a03adf46f52 tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] Calling method '.version_select at 0x7f98b0246378>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:21.974459 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e2a291fb-76fd-4ced-b89f-4a03adf46f52 tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.151236 Feb 17 03:33:21.977524 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 423/857] 10.222.0.57 () {58 vars in 1160 bytes} [Wed Feb 17 03:33:21 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:33:21.997787 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5124d36d-2b55-4adb-89a8-1bfd072fe4b3 tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] Calling method '.version_select at 0x7f98b02da730>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:22.177549 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-313ba7f2-bc55-4a16-a48a-a2f9c637bad1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:22.197294 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-313ba7f2-bc55-4a16-a48a-a2f9c637bad1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:22.200818 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-313ba7f2-bc55-4a16-a48a-a2f9c637bad1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:22.203101 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-313ba7f2-bc55-4a16-a48a-a2f9c637bad1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1718 microversion: 2.20 time: 0.545516 Feb 17 03:33:22.204408 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 435/858] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:21 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1718 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:22.229383 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5124d36d-2b55-4adb-89a8-1bfd072fe4b3 tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.244813 Feb 17 03:33:22.229996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 424/859] 10.222.0.57 () {58 vars in 1145 bytes} [Wed Feb 17 03:33:21 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:33:22.242868 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-21b8ce08-7d2f-4271-babe-f311d287c16e tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] Calling method '.version_select at 0x7f98b0593ea0>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:22.355552 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-21b8ce08-7d2f-4271-babe-f311d287c16e tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.117187 Feb 17 03:33:22.356308 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 436/860] 10.222.0.57 () {58 vars in 1178 bytes} [Wed Feb 17 03:33:22 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:33:22.369827 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-73053633-6034-497c-8210-d911b36b9ce3 tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] Calling method '.version_select at 0x7f98b0246400>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:22.478674 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-73053633-6034-497c-8210-d911b36b9ce3 tempest-VolumesTestJSON-1055691963 tempest-VolumesTestJSON-1055691963-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.113012 Feb 17 03:33:22.479925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 425/861] 10.222.0.57 () {58 vars in 1145 bytes} [Wed Feb 17 03:33:22 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:33:23.224146 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-05c81658-e5f2-4e3c-951e-40c83838cb71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:23.224818 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-05c81658-e5f2-4e3c-951e-40c83838cb71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:23.233594 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-05c81658-e5f2-4e3c-951e-40c83838cb71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:23.234102 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-05c81658-e5f2-4e3c-951e-40c83838cb71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:23.234946 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-05c81658-e5f2-4e3c-951e-40c83838cb71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:23.235433 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-05c81658-e5f2-4e3c-951e-40c83838cb71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:23.459401 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-05c81658-e5f2-4e3c-951e-40c83838cb71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:23.469982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-05c81658-e5f2-4e3c-951e-40c83838cb71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:23.471676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-05c81658-e5f2-4e3c-951e-40c83838cb71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:23.473289 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-05c81658-e5f2-4e3c-951e-40c83838cb71 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1718 microversion: 2.20 time: 0.252968 Feb 17 03:33:23.473850 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 437/862] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:23 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1718 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:24.492582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-511373b0-ae19-426c-8afc-500b732544a3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:24.493830 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-511373b0-ae19-426c-8afc-500b732544a3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:24.502250 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-511373b0-ae19-426c-8afc-500b732544a3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:24.502946 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-511373b0-ae19-426c-8afc-500b732544a3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:24.504234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-511373b0-ae19-426c-8afc-500b732544a3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:24.504735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-511373b0-ae19-426c-8afc-500b732544a3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:25.213573 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-511373b0-ae19-426c-8afc-500b732544a3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:25.228286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-511373b0-ae19-426c-8afc-500b732544a3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:25.232075 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-511373b0-ae19-426c-8afc-500b732544a3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:25.233795 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-511373b0-ae19-426c-8afc-500b732544a3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1718 microversion: 2.20 time: 0.745393 Feb 17 03:33:25.234479 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 426/863] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:24 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1718 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:25.889700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-180481d6-711f-4a0f-b15f-77c9b25f32cb req-1af7e402-3607-4f40-9bc6-f93a37982b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4840bec6-59fa-4a75-9cab-b8eba3fced9d", "name": "network-vif-unplugged", "status": "completed", "tag": "3122eba0-b4d4-415e-b7c0-f67223c6ab3f"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:25.891438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:33:25.891438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:33:25.900829 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-180481d6-711f-4a0f-b15f-77c9b25f32cb req-1af7e402-3607-4f40-9bc6-f93a37982b31 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:25.901693 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-180481d6-711f-4a0f-b15f-77c9b25f32cb req-1af7e402-3607-4f40-9bc6-f93a37982b31 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:25.920306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.compute.server_external_events [req-180481d6-711f-4a0f-b15f-77c9b25f32cb req-1af7e402-3607-4f40-9bc6-f93a37982b31 service nova] Unable to find a host for instance 4840bec6-59fa-4a75-9cab-b8eba3fced9d. Dropping event network-vif-unplugged {{(pid=98103) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Feb 17 03:33:25.921296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-180481d6-711f-4a0f-b15f-77c9b25f32cb req-1af7e402-3607-4f40-9bc6-f93a37982b31 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.288331 Feb 17 03:33:25.921954 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 438/864] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:33:25 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 290 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 17 03:33:26.254179 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6e663c03-d3d3-4906-89aa-6af5a98da710 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:26.255156 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6e663c03-d3d3-4906-89aa-6af5a98da710 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:26.263602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e663c03-d3d3-4906-89aa-6af5a98da710 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:26.264199 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e663c03-d3d3-4906-89aa-6af5a98da710 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:26.265340 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e663c03-d3d3-4906-89aa-6af5a98da710 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:26.265843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6e663c03-d3d3-4906-89aa-6af5a98da710 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:26.505652 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6e663c03-d3d3-4906-89aa-6af5a98da710 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:26.517088 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6e663c03-d3d3-4906-89aa-6af5a98da710 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:26.519016 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6e663c03-d3d3-4906-89aa-6af5a98da710 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:26.520634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6e663c03-d3d3-4906-89aa-6af5a98da710 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1661 microversion: 2.20 time: 0.270643 Feb 17 03:33:26.521364 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 427/865] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:26 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1661 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:26.540606 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2f24ec44-0f47-4763-99d3-d3419d5cc7f2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b916a0dc-1945-4563-9dc7-abffc97e1e94"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:26.541835 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2f24ec44-0f47-4763-99d3-d3419d5cc7f2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:26.549823 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2f24ec44-0f47-4763-99d3-d3419d5cc7f2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:26.550307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2f24ec44-0f47-4763-99d3-d3419d5cc7f2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:26.551349 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2f24ec44-0f47-4763-99d3-d3419d5cc7f2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:26.552014 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2f24ec44-0f47-4763-99d3-d3419d5cc7f2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:27.048858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2f24ec44-0f47-4763-99d3-d3419d5cc7f2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.512407 Feb 17 03:33:27.049772 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 439/866] 10.222.0.57 () {62 vars in 1354 bytes} [Wed Feb 17 03:33:26 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/os-volume_attachments => generated 188 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:33:27.169915 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a2c276f9-b25b-4323-ad95-d5763a733c70 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:27.170535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a2c276f9-b25b-4323-ad95-d5763a733c70 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:27.180187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a2c276f9-b25b-4323-ad95-d5763a733c70 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:27.180759 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a2c276f9-b25b-4323-ad95-d5763a733c70 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:27.181616 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a2c276f9-b25b-4323-ad95-d5763a733c70 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:27.182113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a2c276f9-b25b-4323-ad95-d5763a733c70 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:27.349868 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a2c276f9-b25b-4323-ad95-d5763a733c70 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action" status: 202 len: 0 microversion: 2.20 time: 0.183968 Feb 17 03:33:27.350495 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 428/867] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:33:27 2021] POST /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:33:27.359022 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-eb38d274-42b3-4fb6-ae33-7113b3a5fd88 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:27.359691 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-eb38d274-42b3-4fb6-ae33-7113b3a5fd88 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:27.368172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eb38d274-42b3-4fb6-ae33-7113b3a5fd88 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:27.368895 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eb38d274-42b3-4fb6-ae33-7113b3a5fd88 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:27.369916 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eb38d274-42b3-4fb6-ae33-7113b3a5fd88 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:27.370562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eb38d274-42b3-4fb6-ae33-7113b3a5fd88 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:27.863217 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-eb38d274-42b3-4fb6-ae33-7113b3a5fd88 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:27.874631 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-eb38d274-42b3-4fb6-ae33-7113b3a5fd88 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:27.876243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-eb38d274-42b3-4fb6-ae33-7113b3a5fd88 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:27.877491 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-eb38d274-42b3-4fb6-ae33-7113b3a5fd88 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1747 microversion: 2.20 time: 0.522486 Feb 17 03:33:27.878062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 440/868] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:27 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1747 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:28.269232 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e11f956b-fd1e-4030-9790-7b593139dae1 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] Action: 'create', calling method: .version_select at 0x7f98b02468c8>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1497131032", "metadata": {"Type": "work"}}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:28.271377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e11f956b-fd1e-4030-9790-7b593139dae1 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:33:28.272464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e11f956b-fd1e-4030-9790-7b593139dae1 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.248531 Feb 17 03:33:28.273273 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 429/869] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Feb 17 03:33:28 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 250 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 03:33:28.284005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fcf30007-3b14-4517-a1c0-0629f3ffe558 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] Action: 'create', calling method: .version_select at 0x7f98b01a20d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-921662887", "metadata": {"Type": "work"}}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:28.285837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fcf30007-3b14-4517-a1c0-0629f3ffe558 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:33:28.286854 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fcf30007-3b14-4517-a1c0-0629f3ffe558 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007833 Feb 17 03:33:28.287541 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 441/870] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Feb 17 03:33:28 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 03:33:28.298811 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8afff5eb-eb39-4861-a189-a2a5cc949975 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] Action: 'create', calling method: .version_select at 0x7f98aaff7400>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1279583118", "metadata": {"Type": "work"}}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:33:28.300312 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8afff5eb-eb39-4861-a189-a2a5cc949975 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:33:28.302374 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8afff5eb-eb39-4861-a189-a2a5cc949975 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008675 Feb 17 03:33:28.303198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 430/871] 10.222.0.57 () {60 vars in 1146 bytes} [Wed Feb 17 03:33:28 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 17 03:33:28.317149 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-64a6c93b-1023-47a4-866f-7a753c6becb4 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] Calling method '.version_select at 0x7f98b0177488>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:28.401278 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-64a6c93b-1023-47a4-866f-7a753c6becb4 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] HTTP exception thrown: Volume tempest-invalid-347810429 could not be found. Feb 17 03:33:28.402303 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-64a6c93b-1023-47a4-866f-7a753c6becb4 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] Returning 404 to user: Volume tempest-invalid-347810429 could not be found. {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:33:28.403407 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-64a6c93b-1023-47a4-866f-7a753c6becb4 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-347810429" status: 404 len: 98 microversion: 2.1 time: 0.092333 Feb 17 03:33:28.404005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 442/872] 10.222.0.57 () {58 vars in 1205 bytes} [Wed Feb 17 03:33:28 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-347810429 => generated 98 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 17 03:33:28.415389 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-98a3dc09-0f79-4be4-a590-36d9f11591d3 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005711 Feb 17 03:33:28.416042 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 431/873] 10.222.0.57 () {58 vars in 1130 bytes} [Wed Feb 17 03:33:28 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 17 03:33:28.426185 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c612caee-0963-418e-87ef-0539d882f349 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004422 Feb 17 03:33:28.426730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 443/874] 10.222.0.57 () {58 vars in 1127 bytes} [Wed Feb 17 03:33:28 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 17 03:33:28.437133 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2377c90d-e493-407f-b347-04571408a588 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] Calling method '.version_select at 0x7f98aaff7268>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:28.507386 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-2377c90d-e493-407f-b347-04571408a588 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] HTTP exception thrown: Volume 44095fa6-6e3c-4449-922b-ba6d094a12b4 could not be found. Feb 17 03:33:28.508077 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2377c90d-e493-407f-b347-04571408a588 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] Returning 404 to user: Volume 44095fa6-6e3c-4449-922b-ba6d094a12b4 could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:33:28.508992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2377c90d-e493-407f-b347-04571408a588 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/44095fa6-6e3c-4449-922b-ba6d094a12b4" status: 404 len: 109 microversion: 2.1 time: 0.076334 Feb 17 03:33:28.513945 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 432/875] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Feb 17 03:33:28 2021] DELETE /compute/v2.1/os-volumes/44095fa6-6e3c-4449-922b-ba6d094a12b4 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:33:28.519913 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c9c695bb-2d31-44e4-a6c8-2f3db5c03286 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] Calling method '.version_select at 0x7f98b4532268>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:28.589333 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-c9c695bb-2d31-44e4-a6c8-2f3db5c03286 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] HTTP exception thrown: Volume 196d36ca-ebec-418b-b833-0d33b2a3dbb8 could not be found. Feb 17 03:33:28.590228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c9c695bb-2d31-44e4-a6c8-2f3db5c03286 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] Returning 404 to user: Volume 196d36ca-ebec-418b-b833-0d33b2a3dbb8 could not be found. {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:33:28.591598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c9c695bb-2d31-44e4-a6c8-2f3db5c03286 tempest-VolumesNegativeTest-2039742518 tempest-VolumesNegativeTest-2039742518-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/196d36ca-ebec-418b-b833-0d33b2a3dbb8" status: 404 len: 109 microversion: 2.1 time: 0.075925 Feb 17 03:33:28.592732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 444/876] 10.222.0.57 () {58 vars in 1235 bytes} [Wed Feb 17 03:33:28 2021] GET /compute/v2.1/os-volumes/196d36ca-ebec-418b-b833-0d33b2a3dbb8 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:33:28.898560 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-404a8269-a8a5-4061-be83-2e1325274ddb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:28.899241 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-404a8269-a8a5-4061-be83-2e1325274ddb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:28.917988 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-404a8269-a8a5-4061-be83-2e1325274ddb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:28.918512 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-404a8269-a8a5-4061-be83-2e1325274ddb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:28.919426 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-404a8269-a8a5-4061-be83-2e1325274ddb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:28.919932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-404a8269-a8a5-4061-be83-2e1325274ddb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:29.241559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-404a8269-a8a5-4061-be83-2e1325274ddb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:29.251819 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-404a8269-a8a5-4061-be83-2e1325274ddb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:29.253428 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-404a8269-a8a5-4061-be83-2e1325274ddb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:29.254673 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-404a8269-a8a5-4061-be83-2e1325274ddb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1749 microversion: 2.20 time: 0.360878 Feb 17 03:33:29.255230 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 433/877] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:28 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1749 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:30.276872 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-eda917b1-929b-49ec-8a0a-74acfbcd2bb9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:30.277414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-eda917b1-929b-49ec-8a0a-74acfbcd2bb9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:30.290781 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eda917b1-929b-49ec-8a0a-74acfbcd2bb9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:30.291490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eda917b1-929b-49ec-8a0a-74acfbcd2bb9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:30.292694 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eda917b1-929b-49ec-8a0a-74acfbcd2bb9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:30.293226 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eda917b1-929b-49ec-8a0a-74acfbcd2bb9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:30.538019 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-eda917b1-929b-49ec-8a0a-74acfbcd2bb9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:30.550843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-eda917b1-929b-49ec-8a0a-74acfbcd2bb9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:30.552630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-eda917b1-929b-49ec-8a0a-74acfbcd2bb9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:30.554281 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-eda917b1-929b-49ec-8a0a-74acfbcd2bb9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1749 microversion: 2.20 time: 0.283310 Feb 17 03:33:30.566916 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 445/878] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:30 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1749 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:31.578575 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-776f54b9-d20e-485d-a07b-1c32ff13994f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:31.579357 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-776f54b9-d20e-485d-a07b-1c32ff13994f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:31.587832 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-776f54b9-d20e-485d-a07b-1c32ff13994f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:31.588337 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-776f54b9-d20e-485d-a07b-1c32ff13994f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:31.589216 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-776f54b9-d20e-485d-a07b-1c32ff13994f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:31.589713 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-776f54b9-d20e-485d-a07b-1c32ff13994f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:31.804393 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-776f54b9-d20e-485d-a07b-1c32ff13994f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:31.814475 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-776f54b9-d20e-485d-a07b-1c32ff13994f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:31.816060 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-776f54b9-d20e-485d-a07b-1c32ff13994f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:31.817310 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-776f54b9-d20e-485d-a07b-1c32ff13994f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.247987 Feb 17 03:33:31.817901 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 434/879] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:31 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:32.839562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cc215bd5-9702-4d3e-b613-5a94a029a1be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:32.841200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cc215bd5-9702-4d3e-b613-5a94a029a1be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:32.857949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cc215bd5-9702-4d3e-b613-5a94a029a1be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:32.858909 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cc215bd5-9702-4d3e-b613-5a94a029a1be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:32.859760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cc215bd5-9702-4d3e-b613-5a94a029a1be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:32.860473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cc215bd5-9702-4d3e-b613-5a94a029a1be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:33.176769 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-cc215bd5-9702-4d3e-b613-5a94a029a1be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:33.188789 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-cc215bd5-9702-4d3e-b613-5a94a029a1be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:33.190459 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-cc215bd5-9702-4d3e-b613-5a94a029a1be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:33.191664 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cc215bd5-9702-4d3e-b613-5a94a029a1be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.358004 Feb 17 03:33:33.205391 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 446/880] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:32 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:34.215015 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f3e3622d-5221-4db8-89d5-6b88e4d583ec tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:34.218931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f3e3622d-5221-4db8-89d5-6b88e4d583ec tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:34.230212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f3e3622d-5221-4db8-89d5-6b88e4d583ec tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:34.231040 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f3e3622d-5221-4db8-89d5-6b88e4d583ec tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:34.231904 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f3e3622d-5221-4db8-89d5-6b88e4d583ec tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:34.232404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f3e3622d-5221-4db8-89d5-6b88e4d583ec tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:34.482690 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f3e3622d-5221-4db8-89d5-6b88e4d583ec tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:34.495428 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f3e3622d-5221-4db8-89d5-6b88e4d583ec tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:34.497517 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f3e3622d-5221-4db8-89d5-6b88e4d583ec tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:34.498765 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f3e3622d-5221-4db8-89d5-6b88e4d583ec tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.287814 Feb 17 03:33:34.499526 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 435/881] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:34 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:35.517713 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-eab6e285-b77a-4313-acfa-11d6fba08811 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:35.518504 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-eab6e285-b77a-4313-acfa-11d6fba08811 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:35.530616 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eab6e285-b77a-4313-acfa-11d6fba08811 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:35.531300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eab6e285-b77a-4313-acfa-11d6fba08811 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:35.532563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eab6e285-b77a-4313-acfa-11d6fba08811 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:35.533359 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eab6e285-b77a-4313-acfa-11d6fba08811 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:35.817902 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-eab6e285-b77a-4313-acfa-11d6fba08811 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:35.828813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-eab6e285-b77a-4313-acfa-11d6fba08811 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:35.830430 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-eab6e285-b77a-4313-acfa-11d6fba08811 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:35.831611 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-eab6e285-b77a-4313-acfa-11d6fba08811 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.317946 Feb 17 03:33:35.832201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 447/882] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:35 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:36.868919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b2c1f508-49be-45a7-8d27-ab3b8074e5b7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:36.869634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b2c1f508-49be-45a7-8d27-ab3b8074e5b7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:36.891296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b2c1f508-49be-45a7-8d27-ab3b8074e5b7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:36.891803 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b2c1f508-49be-45a7-8d27-ab3b8074e5b7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:36.892656 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b2c1f508-49be-45a7-8d27-ab3b8074e5b7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:36.893183 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b2c1f508-49be-45a7-8d27-ab3b8074e5b7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:37.114539 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b2c1f508-49be-45a7-8d27-ab3b8074e5b7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:37.124858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b2c1f508-49be-45a7-8d27-ab3b8074e5b7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:37.126452 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b2c1f508-49be-45a7-8d27-ab3b8074e5b7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:37.127639 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b2c1f508-49be-45a7-8d27-ab3b8074e5b7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.280522 Feb 17 03:33:37.128197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 436/883] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:36 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:38.148250 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e5e0d8f8-ff45-406b-9b4e-365d809414be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:38.149909 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e5e0d8f8-ff45-406b-9b4e-365d809414be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:38.160945 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5e0d8f8-ff45-406b-9b4e-365d809414be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:38.162118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5e0d8f8-ff45-406b-9b4e-365d809414be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:38.164055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5e0d8f8-ff45-406b-9b4e-365d809414be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:38.164756 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5e0d8f8-ff45-406b-9b4e-365d809414be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:38.387467 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e5e0d8f8-ff45-406b-9b4e-365d809414be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:38.398226 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e5e0d8f8-ff45-406b-9b4e-365d809414be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:38.399848 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e5e0d8f8-ff45-406b-9b4e-365d809414be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:38.401006 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e5e0d8f8-ff45-406b-9b4e-365d809414be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.257221 Feb 17 03:33:38.403185 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 448/884] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:38 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:39.422168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d808007b-ca9b-4780-b59d-ba6e66bee2f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:39.422834 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d808007b-ca9b-4780-b59d-ba6e66bee2f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:39.431297 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d808007b-ca9b-4780-b59d-ba6e66bee2f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:39.431802 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d808007b-ca9b-4780-b59d-ba6e66bee2f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:39.432639 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d808007b-ca9b-4780-b59d-ba6e66bee2f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:39.433158 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d808007b-ca9b-4780-b59d-ba6e66bee2f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:39.654921 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d808007b-ca9b-4780-b59d-ba6e66bee2f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:39.665433 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d808007b-ca9b-4780-b59d-ba6e66bee2f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:39.667022 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d808007b-ca9b-4780-b59d-ba6e66bee2f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:39.668452 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d808007b-ca9b-4780-b59d-ba6e66bee2f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.250261 Feb 17 03:33:39.669225 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 437/885] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:39 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:40.689304 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4c74e2b8-0347-4f14-a2a7-633a5b9f5126 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:40.689970 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4c74e2b8-0347-4f14-a2a7-633a5b9f5126 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:40.698652 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c74e2b8-0347-4f14-a2a7-633a5b9f5126 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:40.699164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c74e2b8-0347-4f14-a2a7-633a5b9f5126 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:40.699999 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c74e2b8-0347-4f14-a2a7-633a5b9f5126 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:40.700487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c74e2b8-0347-4f14-a2a7-633a5b9f5126 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:40.915734 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4c74e2b8-0347-4f14-a2a7-633a5b9f5126 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:40.925648 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4c74e2b8-0347-4f14-a2a7-633a5b9f5126 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:40.927232 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4c74e2b8-0347-4f14-a2a7-633a5b9f5126 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:40.928444 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4c74e2b8-0347-4f14-a2a7-633a5b9f5126 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.243258 Feb 17 03:33:40.929546 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 449/886] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:40 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:41.949282 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-68082130-2319-4124-894c-3534417219f3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:41.950072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-68082130-2319-4124-894c-3534417219f3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:41.959195 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-68082130-2319-4124-894c-3534417219f3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:41.959883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-68082130-2319-4124-894c-3534417219f3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:41.961501 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-68082130-2319-4124-894c-3534417219f3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:41.967025 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-68082130-2319-4124-894c-3534417219f3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:42.198145 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-68082130-2319-4124-894c-3534417219f3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:42.210725 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-68082130-2319-4124-894c-3534417219f3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:42.212347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-68082130-2319-4124-894c-3534417219f3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:42.214626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-68082130-2319-4124-894c-3534417219f3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.269224 Feb 17 03:33:42.216063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 438/887] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:41 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:43.238376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0c559aa9-4a6c-4392-b020-b8855ab1e39d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:43.239197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0c559aa9-4a6c-4392-b020-b8855ab1e39d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:43.248234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c559aa9-4a6c-4392-b020-b8855ab1e39d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:43.248732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c559aa9-4a6c-4392-b020-b8855ab1e39d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:43.249599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c559aa9-4a6c-4392-b020-b8855ab1e39d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:43.250082 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c559aa9-4a6c-4392-b020-b8855ab1e39d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:43.485308 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0c559aa9-4a6c-4392-b020-b8855ab1e39d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:43.498645 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0c559aa9-4a6c-4392-b020-b8855ab1e39d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:43.500242 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0c559aa9-4a6c-4392-b020-b8855ab1e39d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:43.501477 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0c559aa9-4a6c-4392-b020-b8855ab1e39d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.270002 Feb 17 03:33:43.502288 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 450/888] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:43 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:44.527161 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-695075f0-5939-40c9-89d8-b15a2a6bcd94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:44.528709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-695075f0-5939-40c9-89d8-b15a2a6bcd94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:44.539567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-695075f0-5939-40c9-89d8-b15a2a6bcd94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:44.540627 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-695075f0-5939-40c9-89d8-b15a2a6bcd94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:44.541978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-695075f0-5939-40c9-89d8-b15a2a6bcd94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:44.542547 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-695075f0-5939-40c9-89d8-b15a2a6bcd94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:44.786206 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-695075f0-5939-40c9-89d8-b15a2a6bcd94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:44.797213 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-695075f0-5939-40c9-89d8-b15a2a6bcd94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:44.798802 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-695075f0-5939-40c9-89d8-b15a2a6bcd94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:44.799997 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-695075f0-5939-40c9-89d8-b15a2a6bcd94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.279982 Feb 17 03:33:44.800584 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 439/889] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:44 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:45.820516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-42175d34-b0d9-4eb1-9a47-92fed7bf460e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:45.821236 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-42175d34-b0d9-4eb1-9a47-92fed7bf460e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:45.829245 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-42175d34-b0d9-4eb1-9a47-92fed7bf460e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:45.829986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-42175d34-b0d9-4eb1-9a47-92fed7bf460e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:45.830834 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-42175d34-b0d9-4eb1-9a47-92fed7bf460e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:45.831330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-42175d34-b0d9-4eb1-9a47-92fed7bf460e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:46.129948 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-42175d34-b0d9-4eb1-9a47-92fed7bf460e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:46.140506 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-42175d34-b0d9-4eb1-9a47-92fed7bf460e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:46.142394 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-42175d34-b0d9-4eb1-9a47-92fed7bf460e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:46.143990 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-42175d34-b0d9-4eb1-9a47-92fed7bf460e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.327876 Feb 17 03:33:46.144749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 451/890] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:45 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:47.164257 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5f994b9a-fd49-4bec-99bb-118b684e18ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:47.164916 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5f994b9a-fd49-4bec-99bb-118b684e18ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:47.173432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f994b9a-fd49-4bec-99bb-118b684e18ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:47.173945 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f994b9a-fd49-4bec-99bb-118b684e18ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:47.174905 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f994b9a-fd49-4bec-99bb-118b684e18ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:47.175489 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f994b9a-fd49-4bec-99bb-118b684e18ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:47.426423 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5f994b9a-fd49-4bec-99bb-118b684e18ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:47.439104 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5f994b9a-fd49-4bec-99bb-118b684e18ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:47.441207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5f994b9a-fd49-4bec-99bb-118b684e18ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:47.442442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5f994b9a-fd49-4bec-99bb-118b684e18ed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.282362 Feb 17 03:33:47.443013 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 440/891] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:47 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:48.465743 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-efe0289c-e6c1-4c5b-bd76-abd3b63b7e82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:48.466483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-efe0289c-e6c1-4c5b-bd76-abd3b63b7e82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:48.477592 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-efe0289c-e6c1-4c5b-bd76-abd3b63b7e82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:48.478100 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-efe0289c-e6c1-4c5b-bd76-abd3b63b7e82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:48.479115 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-efe0289c-e6c1-4c5b-bd76-abd3b63b7e82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:48.479965 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-efe0289c-e6c1-4c5b-bd76-abd3b63b7e82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:48.702245 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-efe0289c-e6c1-4c5b-bd76-abd3b63b7e82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:48.713174 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-efe0289c-e6c1-4c5b-bd76-abd3b63b7e82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:48.714770 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-efe0289c-e6c1-4c5b-bd76-abd3b63b7e82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:48.716001 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-efe0289c-e6c1-4c5b-bd76-abd3b63b7e82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.255192 Feb 17 03:33:48.716545 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 452/892] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:48 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:49.735606 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c340310a-7f1b-4226-ae72-453e2a36f393 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:49.736271 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c340310a-7f1b-4226-ae72-453e2a36f393 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:49.744700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c340310a-7f1b-4226-ae72-453e2a36f393 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:49.745262 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c340310a-7f1b-4226-ae72-453e2a36f393 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:49.746101 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c340310a-7f1b-4226-ae72-453e2a36f393 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:49.746588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c340310a-7f1b-4226-ae72-453e2a36f393 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:49.991077 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c340310a-7f1b-4226-ae72-453e2a36f393 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:50.004118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c340310a-7f1b-4226-ae72-453e2a36f393 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:50.006004 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c340310a-7f1b-4226-ae72-453e2a36f393 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:50.007404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c340310a-7f1b-4226-ae72-453e2a36f393 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.275804 Feb 17 03:33:50.008289 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 441/893] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:49 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:51.028281 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8af131df-93d0-477a-a496-2aa1e4f24499 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:51.028912 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8af131df-93d0-477a-a496-2aa1e4f24499 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:51.036745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8af131df-93d0-477a-a496-2aa1e4f24499 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:51.037280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8af131df-93d0-477a-a496-2aa1e4f24499 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:51.038118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8af131df-93d0-477a-a496-2aa1e4f24499 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:51.038602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8af131df-93d0-477a-a496-2aa1e4f24499 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:51.259455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8af131df-93d0-477a-a496-2aa1e4f24499 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:51.269498 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8af131df-93d0-477a-a496-2aa1e4f24499 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:51.270966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8af131df-93d0-477a-a496-2aa1e4f24499 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:51.272140 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8af131df-93d0-477a-a496-2aa1e4f24499 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.248781 Feb 17 03:33:51.272722 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 453/894] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:51 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:52.292096 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-917fd2d5-a7b4-47b0-b769-c1ef4cfd0d7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:52.292761 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-917fd2d5-a7b4-47b0-b769-c1ef4cfd0d7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:52.300716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-917fd2d5-a7b4-47b0-b769-c1ef4cfd0d7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:52.301260 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-917fd2d5-a7b4-47b0-b769-c1ef4cfd0d7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:52.302104 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-917fd2d5-a7b4-47b0-b769-c1ef4cfd0d7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:52.302595 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-917fd2d5-a7b4-47b0-b769-c1ef4cfd0d7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:52.523082 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-917fd2d5-a7b4-47b0-b769-c1ef4cfd0d7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:52.533163 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-917fd2d5-a7b4-47b0-b769-c1ef4cfd0d7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:52.534768 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-917fd2d5-a7b4-47b0-b769-c1ef4cfd0d7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:52.535978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-917fd2d5-a7b4-47b0-b769-c1ef4cfd0d7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.248455 Feb 17 03:33:52.536567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 442/895] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:52 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:53.556735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-10e2c91f-a405-4ede-9471-34de4cefd33e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:53.557362 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-10e2c91f-a405-4ede-9471-34de4cefd33e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:53.565191 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-10e2c91f-a405-4ede-9471-34de4cefd33e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:53.565702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-10e2c91f-a405-4ede-9471-34de4cefd33e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:53.566959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-10e2c91f-a405-4ede-9471-34de4cefd33e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:53.567093 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-10e2c91f-a405-4ede-9471-34de4cefd33e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:53.780032 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-10e2c91f-a405-4ede-9471-34de4cefd33e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:53.790507 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-10e2c91f-a405-4ede-9471-34de4cefd33e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:53.792074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-10e2c91f-a405-4ede-9471-34de4cefd33e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:53.793299 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-10e2c91f-a405-4ede-9471-34de4cefd33e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.241251 Feb 17 03:33:53.793887 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 454/896] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:53 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:54.814074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-48509630-484f-447a-b47e-ced550330dd6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:54.814734 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-48509630-484f-447a-b47e-ced550330dd6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:54.823442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-48509630-484f-447a-b47e-ced550330dd6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:54.823919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-48509630-484f-447a-b47e-ced550330dd6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:54.824754 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-48509630-484f-447a-b47e-ced550330dd6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:54.825270 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-48509630-484f-447a-b47e-ced550330dd6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:55.038561 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-48509630-484f-447a-b47e-ced550330dd6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:55.048314 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-48509630-484f-447a-b47e-ced550330dd6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:55.049912 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-48509630-484f-447a-b47e-ced550330dd6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:55.051077 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-48509630-484f-447a-b47e-ced550330dd6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.241182 Feb 17 03:33:55.051658 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 443/897] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:54 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:56.071891 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-938ac5c7-7af9-4956-a206-64d148da0063 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:56.072549 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-938ac5c7-7af9-4956-a206-64d148da0063 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:56.080543 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-938ac5c7-7af9-4956-a206-64d148da0063 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:56.081140 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-938ac5c7-7af9-4956-a206-64d148da0063 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:56.081974 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-938ac5c7-7af9-4956-a206-64d148da0063 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:56.082462 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-938ac5c7-7af9-4956-a206-64d148da0063 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:56.319718 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-938ac5c7-7af9-4956-a206-64d148da0063 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:56.333941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-938ac5c7-7af9-4956-a206-64d148da0063 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:56.336119 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-938ac5c7-7af9-4956-a206-64d148da0063 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:56.338515 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-938ac5c7-7af9-4956-a206-64d148da0063 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.271284 Feb 17 03:33:56.339129 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 455/898] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:56 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:57.360989 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ee91791c-5fc1-4a85-b0c6-d2b46762e7c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:57.361681 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ee91791c-5fc1-4a85-b0c6-d2b46762e7c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:57.369883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee91791c-5fc1-4a85-b0c6-d2b46762e7c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:57.370389 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee91791c-5fc1-4a85-b0c6-d2b46762e7c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:57.371233 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee91791c-5fc1-4a85-b0c6-d2b46762e7c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:57.371718 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee91791c-5fc1-4a85-b0c6-d2b46762e7c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:57.612949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ee91791c-5fc1-4a85-b0c6-d2b46762e7c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:57.628158 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ee91791c-5fc1-4a85-b0c6-d2b46762e7c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:57.629838 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ee91791c-5fc1-4a85-b0c6-d2b46762e7c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:57.631063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ee91791c-5fc1-4a85-b0c6-d2b46762e7c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.274150 Feb 17 03:33:57.631659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 444/899] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:57 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:58.653715 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e4c04d21-5172-4425-a61e-ce2de9a3670c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:58.654496 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e4c04d21-5172-4425-a61e-ce2de9a3670c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:58.662592 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e4c04d21-5172-4425-a61e-ce2de9a3670c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:58.663105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e4c04d21-5172-4425-a61e-ce2de9a3670c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:58.663962 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e4c04d21-5172-4425-a61e-ce2de9a3670c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:58.665062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e4c04d21-5172-4425-a61e-ce2de9a3670c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:58.929072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e4c04d21-5172-4425-a61e-ce2de9a3670c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:58.945801 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e4c04d21-5172-4425-a61e-ce2de9a3670c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:58.947581 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e4c04d21-5172-4425-a61e-ce2de9a3670c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:33:58.948975 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e4c04d21-5172-4425-a61e-ce2de9a3670c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.300319 Feb 17 03:33:58.949643 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 456/900] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:58 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:33:59.969055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-01cbb802-e407-4fe4-9d58-44d66427a716 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:33:59.971208 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-01cbb802-e407-4fe4-9d58-44d66427a716 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:33:59.978439 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-01cbb802-e407-4fe4-9d58-44d66427a716 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:59.978982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-01cbb802-e407-4fe4-9d58-44d66427a716 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:33:59.979830 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-01cbb802-e407-4fe4-9d58-44d66427a716 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:33:59.980323 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-01cbb802-e407-4fe4-9d58-44d66427a716 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:00.201235 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-01cbb802-e407-4fe4-9d58-44d66427a716 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:00.211446 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-01cbb802-e407-4fe4-9d58-44d66427a716 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:00.213710 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-01cbb802-e407-4fe4-9d58-44d66427a716 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:00.214897 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-01cbb802-e407-4fe4-9d58-44d66427a716 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.250131 Feb 17 03:34:00.215484 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 445/901] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:33:59 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:01.234939 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3b733ff3-9a56-407e-9aa2-518a2fb1642f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:01.235537 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3b733ff3-9a56-407e-9aa2-518a2fb1642f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:01.244286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3b733ff3-9a56-407e-9aa2-518a2fb1642f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:01.244801 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3b733ff3-9a56-407e-9aa2-518a2fb1642f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:01.245698 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3b733ff3-9a56-407e-9aa2-518a2fb1642f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:01.246194 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3b733ff3-9a56-407e-9aa2-518a2fb1642f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:01.468397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3b733ff3-9a56-407e-9aa2-518a2fb1642f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:01.478824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3b733ff3-9a56-407e-9aa2-518a2fb1642f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:01.480407 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3b733ff3-9a56-407e-9aa2-518a2fb1642f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:01.481667 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3b733ff3-9a56-407e-9aa2-518a2fb1642f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.251044 Feb 17 03:34:01.482488 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 457/902] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:01 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:01.740375 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-2921b559-3f90-44b0-93fe-0b80481b03e1 req-beec2a40-2d04-43e9-88d4-683387a5811b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4840bec6-59fa-4a75-9cab-b8eba3fced9d", "name": "network-vif-plugged", "status": "completed", "tag": "3122eba0-b4d4-415e-b7c0-f67223c6ab3f"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:34:01.742211 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:34:01.742211 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:34:01.753374 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-2921b559-3f90-44b0-93fe-0b80481b03e1 req-beec2a40-2d04-43e9-88d4-683387a5811b service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:01.754378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-2921b559-3f90-44b0-93fe-0b80481b03e1 req-beec2a40-2d04-43e9-88d4-683387a5811b service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:01.791383 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-2921b559-3f90-44b0-93fe-0b80481b03e1 req-beec2a40-2d04-43e9-88d4-683387a5811b service nova] Creating event network-vif-plugged:3122eba0-b4d4-415e-b7c0-f67223c6ab3f for instance 4840bec6-59fa-4a75-9cab-b8eba3fced9d on hv-cinder-75994 Feb 17 03:34:01.796907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-2921b559-3f90-44b0-93fe-0b80481b03e1 req-beec2a40-2d04-43e9-88d4-683387a5811b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060368 Feb 17 03:34:01.797769 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 446/903] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:34:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:34:02.501947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-548e64c2-661b-497b-a035-7bb4334fa4ee tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:02.502637 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-548e64c2-661b-497b-a035-7bb4334fa4ee tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:02.511711 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-548e64c2-661b-497b-a035-7bb4334fa4ee tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:02.512216 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-548e64c2-661b-497b-a035-7bb4334fa4ee tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:02.513117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-548e64c2-661b-497b-a035-7bb4334fa4ee tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:02.513613 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-548e64c2-661b-497b-a035-7bb4334fa4ee tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:02.762777 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-548e64c2-661b-497b-a035-7bb4334fa4ee tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:02.774126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-548e64c2-661b-497b-a035-7bb4334fa4ee tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:02.775875 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-548e64c2-661b-497b-a035-7bb4334fa4ee tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:02.777278 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-548e64c2-661b-497b-a035-7bb4334fa4ee tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.279456 Feb 17 03:34:02.778402 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 458/904] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:02 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:03.802138 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0706a4db-6eb8-49f3-9276-29012244e27d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:03.802690 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0706a4db-6eb8-49f3-9276-29012244e27d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:03.811463 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0706a4db-6eb8-49f3-9276-29012244e27d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:03.812003 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0706a4db-6eb8-49f3-9276-29012244e27d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:03.812883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0706a4db-6eb8-49f3-9276-29012244e27d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:03.813433 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0706a4db-6eb8-49f3-9276-29012244e27d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:04.056069 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0706a4db-6eb8-49f3-9276-29012244e27d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:04.066015 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0706a4db-6eb8-49f3-9276-29012244e27d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:04.067633 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0706a4db-6eb8-49f3-9276-29012244e27d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:04.068831 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0706a4db-6eb8-49f3-9276-29012244e27d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.272405 Feb 17 03:34:04.069454 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 447/905] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:03 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:05.090086 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0485eca1-af3e-4c2c-995e-9b009ac6ca08 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:05.090897 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0485eca1-af3e-4c2c-995e-9b009ac6ca08 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:05.105081 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0485eca1-af3e-4c2c-995e-9b009ac6ca08 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:05.105580 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0485eca1-af3e-4c2c-995e-9b009ac6ca08 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:05.106445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0485eca1-af3e-4c2c-995e-9b009ac6ca08 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:05.106936 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0485eca1-af3e-4c2c-995e-9b009ac6ca08 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:05.324306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0485eca1-af3e-4c2c-995e-9b009ac6ca08 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:05.334381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0485eca1-af3e-4c2c-995e-9b009ac6ca08 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:05.335962 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0485eca1-af3e-4c2c-995e-9b009ac6ca08 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:05.337207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0485eca1-af3e-4c2c-995e-9b009ac6ca08 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.251510 Feb 17 03:34:05.337794 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 459/906] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:05 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:06.357655 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-27e63f60-7fd7-415c-a236-637a5b7f840f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:06.358328 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-27e63f60-7fd7-415c-a236-637a5b7f840f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:06.366272 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-27e63f60-7fd7-415c-a236-637a5b7f840f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:06.366781 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-27e63f60-7fd7-415c-a236-637a5b7f840f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:06.367619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-27e63f60-7fd7-415c-a236-637a5b7f840f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:06.368095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-27e63f60-7fd7-415c-a236-637a5b7f840f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:06.589993 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-27e63f60-7fd7-415c-a236-637a5b7f840f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:06.600285 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-27e63f60-7fd7-415c-a236-637a5b7f840f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:06.602178 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-27e63f60-7fd7-415c-a236-637a5b7f840f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:06.603353 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-27e63f60-7fd7-415c-a236-637a5b7f840f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.249874 Feb 17 03:34:06.604441 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 448/907] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:06 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:07.623852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8ba3d82b-aea3-47fd-a861-6e6fbffdf9ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:07.624557 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8ba3d82b-aea3-47fd-a861-6e6fbffdf9ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:07.632868 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ba3d82b-aea3-47fd-a861-6e6fbffdf9ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:07.633389 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ba3d82b-aea3-47fd-a861-6e6fbffdf9ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:07.634229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ba3d82b-aea3-47fd-a861-6e6fbffdf9ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:07.634714 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ba3d82b-aea3-47fd-a861-6e6fbffdf9ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:07.860935 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8ba3d82b-aea3-47fd-a861-6e6fbffdf9ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:07.872253 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8ba3d82b-aea3-47fd-a861-6e6fbffdf9ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:07.873870 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8ba3d82b-aea3-47fd-a861-6e6fbffdf9ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:07.875062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8ba3d82b-aea3-47fd-a861-6e6fbffdf9ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.255977 Feb 17 03:34:07.875653 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 460/908] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:07 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:08.896446 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-45ee92ab-4ca3-4946-ab07-1106b11e3e18 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:08.897878 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-45ee92ab-4ca3-4946-ab07-1106b11e3e18 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:08.906210 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45ee92ab-4ca3-4946-ab07-1106b11e3e18 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:08.906728 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45ee92ab-4ca3-4946-ab07-1106b11e3e18 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:08.907709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45ee92ab-4ca3-4946-ab07-1106b11e3e18 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:08.908206 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-45ee92ab-4ca3-4946-ab07-1106b11e3e18 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:09.123957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-45ee92ab-4ca3-4946-ab07-1106b11e3e18 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:09.134097 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-45ee92ab-4ca3-4946-ab07-1106b11e3e18 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:09.135697 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-45ee92ab-4ca3-4946-ab07-1106b11e3e18 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:09.136879 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-45ee92ab-4ca3-4946-ab07-1106b11e3e18 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.244625 Feb 17 03:34:09.137526 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 449/909] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:08 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:10.157688 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2cbca7d0-13f0-4a70-97fc-3ac3e0be9304 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:10.158469 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2cbca7d0-13f0-4a70-97fc-3ac3e0be9304 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:10.167764 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2cbca7d0-13f0-4a70-97fc-3ac3e0be9304 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:10.168215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2cbca7d0-13f0-4a70-97fc-3ac3e0be9304 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:10.169183 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2cbca7d0-13f0-4a70-97fc-3ac3e0be9304 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:10.169831 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2cbca7d0-13f0-4a70-97fc-3ac3e0be9304 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:10.417378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2cbca7d0-13f0-4a70-97fc-3ac3e0be9304 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:10.433692 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2cbca7d0-13f0-4a70-97fc-3ac3e0be9304 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:10.436238 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2cbca7d0-13f0-4a70-97fc-3ac3e0be9304 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:10.438117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2cbca7d0-13f0-4a70-97fc-3ac3e0be9304 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.285081 Feb 17 03:34:10.438986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 461/910] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:10 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:11.459133 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3fe347c0-4bce-4e4d-a68c-d0421bfb1585 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:11.459791 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3fe347c0-4bce-4e4d-a68c-d0421bfb1585 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:11.467681 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3fe347c0-4bce-4e4d-a68c-d0421bfb1585 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:11.468192 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3fe347c0-4bce-4e4d-a68c-d0421bfb1585 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:11.469048 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3fe347c0-4bce-4e4d-a68c-d0421bfb1585 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:11.469543 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3fe347c0-4bce-4e4d-a68c-d0421bfb1585 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:11.692980 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3fe347c0-4bce-4e4d-a68c-d0421bfb1585 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:11.704171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3fe347c0-4bce-4e4d-a68c-d0421bfb1585 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:11.705787 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3fe347c0-4bce-4e4d-a68c-d0421bfb1585 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:11.707249 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3fe347c0-4bce-4e4d-a68c-d0421bfb1585 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1805 microversion: 2.20 time: 0.252311 Feb 17 03:34:11.707719 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 450/911] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:11 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1805 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:12.729001 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7b0f31cb-7cf9-4f83-a612-cf3531ccd7f1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:12.729916 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7b0f31cb-7cf9-4f83-a612-cf3531ccd7f1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:12.737848 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7b0f31cb-7cf9-4f83-a612-cf3531ccd7f1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:12.738320 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7b0f31cb-7cf9-4f83-a612-cf3531ccd7f1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:12.739165 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7b0f31cb-7cf9-4f83-a612-cf3531ccd7f1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:12.739652 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7b0f31cb-7cf9-4f83-a612-cf3531ccd7f1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:12.961094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7b0f31cb-7cf9-4f83-a612-cf3531ccd7f1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:12.971107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7b0f31cb-7cf9-4f83-a612-cf3531ccd7f1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:12.972738 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7b0f31cb-7cf9-4f83-a612-cf3531ccd7f1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:12.973968 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7b0f31cb-7cf9-4f83-a612-cf3531ccd7f1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1792 microversion: 2.20 time: 0.249348 Feb 17 03:34:12.974553 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 462/912] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:34:12 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1792 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:34:29.603913 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:34:29.604522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:34:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:34:34.519890 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:34:34.520432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:34:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:34:44.670109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-075dc8b0-ef46-4d9f-9a03-8f117bb9444a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:44.670676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-075dc8b0-ef46-4d9f-9a03-8f117bb9444a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:44.825136 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-075dc8b0-ef46-4d9f-9a03-8f117bb9444a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:44.825580 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-075dc8b0-ef46-4d9f-9a03-8f117bb9444a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:44.826455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-075dc8b0-ef46-4d9f-9a03-8f117bb9444a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:44.826949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-075dc8b0-ef46-4d9f-9a03-8f117bb9444a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:45.007007 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-075dc8b0-ef46-4d9f-9a03-8f117bb9444a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lazy-loading 'services' on Instance uuid 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 {{(pid=98104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:34:45.155410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-075dc8b0-ef46-4d9f-9a03-8f117bb9444a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/os-volume_attachments/8b26d6c4-47a3-4c01-af17-872394f02d4d" status: 202 len: 0 microversion: 2.1 time: 0.489794 Feb 17 03:34:45.156055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 451/913] 10.222.0.57 () {58 vars in 1406 bytes} [Wed Feb 17 03:34:44 2021] DELETE /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/os-volume_attachments/8b26d6c4-47a3-4c01-af17-872394f02d4d => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:34:46.377573 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7ac66924-0648-433c-acce-b794a3b60d08 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:34:46.385997 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7ac66924-0648-433c-acce-b794a3b60d08 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:46.386424 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7ac66924-0648-433c-acce-b794a3b60d08 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:46.458268 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7ac66924-0648-433c-acce-b794a3b60d08 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Going to try to stop instance {{(pid=98103) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Feb 17 03:34:46.561652 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7ac66924-0648-433c-acce-b794a3b60d08 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 202 len: 0 microversion: 2.1 time: 0.189124 Feb 17 03:34:46.562245 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 463/914] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:34:46 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:34:46.571945 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-58634731-19cf-4848-b4bb-fd38febd00ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:46.572712 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-58634731-19cf-4848-b4bb-fd38febd00ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:46.581768 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-58634731-19cf-4848-b4bb-fd38febd00ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:46.582274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-58634731-19cf-4848-b4bb-fd38febd00ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:46.583122 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-58634731-19cf-4848-b4bb-fd38febd00ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:46.583628 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-58634731-19cf-4848-b4bb-fd38febd00ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:46.826649 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-58634731-19cf-4848-b4bb-fd38febd00ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:46.835575 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-58634731-19cf-4848-b4bb-fd38febd00ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1678 microversion: 2.1 time: 0.268399 Feb 17 03:34:46.836155 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 452/915] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:46 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1678 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:47.855825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1f4007a4-2d40-48ce-a260-cd53cc801fcc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:47.857047 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1f4007a4-2d40-48ce-a260-cd53cc801fcc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:47.867956 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1f4007a4-2d40-48ce-a260-cd53cc801fcc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:47.868462 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1f4007a4-2d40-48ce-a260-cd53cc801fcc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:47.869337 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1f4007a4-2d40-48ce-a260-cd53cc801fcc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:47.869949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1f4007a4-2d40-48ce-a260-cd53cc801fcc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:48.088117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1f4007a4-2d40-48ce-a260-cd53cc801fcc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:48.098071 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1f4007a4-2d40-48ce-a260-cd53cc801fcc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1678 microversion: 2.1 time: 0.246939 Feb 17 03:34:48.098696 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 464/916] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:47 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1678 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:49.116949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-43506f4e-f63d-4e07-91f0-889c15a94543 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:49.117857 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-43506f4e-f63d-4e07-91f0-889c15a94543 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:49.125781 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43506f4e-f63d-4e07-91f0-889c15a94543 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:49.126932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43506f4e-f63d-4e07-91f0-889c15a94543 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:49.127131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43506f4e-f63d-4e07-91f0-889c15a94543 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:49.128072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43506f4e-f63d-4e07-91f0-889c15a94543 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:49.385757 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-43506f4e-f63d-4e07-91f0-889c15a94543 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:49.400821 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-43506f4e-f63d-4e07-91f0-889c15a94543 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1678 microversion: 2.1 time: 0.287813 Feb 17 03:34:49.402143 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 453/917] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:49 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1678 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:50.423224 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9a5f333b-03cf-484a-860a-26aa91e00678 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:50.423887 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9a5f333b-03cf-484a-860a-26aa91e00678 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:50.432277 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a5f333b-03cf-484a-860a-26aa91e00678 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:50.432786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a5f333b-03cf-484a-860a-26aa91e00678 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:50.433686 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a5f333b-03cf-484a-860a-26aa91e00678 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:50.434172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a5f333b-03cf-484a-860a-26aa91e00678 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:50.962668 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9a5f333b-03cf-484a-860a-26aa91e00678 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:50.972591 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9a5f333b-03cf-484a-860a-26aa91e00678 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1678 microversion: 2.1 time: 0.554155 Feb 17 03:34:50.973244 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 465/918] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:50 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1678 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:51.990873 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8ea699a3-f967-454f-999b-29ef0939bc62 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:51.991534 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8ea699a3-f967-454f-999b-29ef0939bc62 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:51.999301 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ea699a3-f967-454f-999b-29ef0939bc62 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:51.999806 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ea699a3-f967-454f-999b-29ef0939bc62 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:52.000629 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ea699a3-f967-454f-999b-29ef0939bc62 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:52.001164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ea699a3-f967-454f-999b-29ef0939bc62 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:52.224544 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8ea699a3-f967-454f-999b-29ef0939bc62 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:52.234687 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8ea699a3-f967-454f-999b-29ef0939bc62 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1678 microversion: 2.1 time: 0.247839 Feb 17 03:34:52.235277 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 454/919] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:51 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1678 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:53.252500 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ac3ccaf7-d8f9-4faa-b745-28105dc9aec1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:53.253356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ac3ccaf7-d8f9-4faa-b745-28105dc9aec1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:53.261313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac3ccaf7-d8f9-4faa-b745-28105dc9aec1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:53.261831 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac3ccaf7-d8f9-4faa-b745-28105dc9aec1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:53.268388 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac3ccaf7-d8f9-4faa-b745-28105dc9aec1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:53.268388 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac3ccaf7-d8f9-4faa-b745-28105dc9aec1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:53.484540 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ac3ccaf7-d8f9-4faa-b745-28105dc9aec1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:53.494107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ac3ccaf7-d8f9-4faa-b745-28105dc9aec1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1678 microversion: 2.1 time: 0.245637 Feb 17 03:34:53.494714 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 466/920] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:53 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1678 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:54.513313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4ff778c0-a066-4b8a-a42a-ac657d03b2b6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:54.514158 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4ff778c0-a066-4b8a-a42a-ac657d03b2b6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:54.522384 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ff778c0-a066-4b8a-a42a-ac657d03b2b6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:54.522896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ff778c0-a066-4b8a-a42a-ac657d03b2b6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:54.523751 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ff778c0-a066-4b8a-a42a-ac657d03b2b6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:54.524290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ff778c0-a066-4b8a-a42a-ac657d03b2b6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:54.745926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4ff778c0-a066-4b8a-a42a-ac657d03b2b6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:54.755548 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4ff778c0-a066-4b8a-a42a-ac657d03b2b6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1678 microversion: 2.1 time: 0.246391 Feb 17 03:34:54.756145 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 455/921] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:54 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1678 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:55.774685 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-33f82b29-c757-4688-baf4-c0c8b5514fed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:55.775455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-33f82b29-c757-4688-baf4-c0c8b5514fed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:55.784206 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-33f82b29-c757-4688-baf4-c0c8b5514fed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:55.784706 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-33f82b29-c757-4688-baf4-c0c8b5514fed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:55.785602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-33f82b29-c757-4688-baf4-c0c8b5514fed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:55.786082 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-33f82b29-c757-4688-baf4-c0c8b5514fed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:56.050639 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-33f82b29-c757-4688-baf4-c0c8b5514fed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:56.059730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-33f82b29-c757-4688-baf4-c0c8b5514fed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1678 microversion: 2.1 time: 0.289288 Feb 17 03:34:56.060332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 467/922] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:55 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1678 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:57.078089 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-32f1647c-636a-49a8-8f0e-7fe35cd5e322 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:57.078833 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-32f1647c-636a-49a8-8f0e-7fe35cd5e322 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:57.086544 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-32f1647c-636a-49a8-8f0e-7fe35cd5e322 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:57.087056 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-32f1647c-636a-49a8-8f0e-7fe35cd5e322 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:57.087903 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-32f1647c-636a-49a8-8f0e-7fe35cd5e322 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:57.088396 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-32f1647c-636a-49a8-8f0e-7fe35cd5e322 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:57.306283 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-32f1647c-636a-49a8-8f0e-7fe35cd5e322 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:57.316650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-32f1647c-636a-49a8-8f0e-7fe35cd5e322 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1678 microversion: 2.1 time: 0.242404 Feb 17 03:34:57.317542 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 456/923] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:57 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1678 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:58.335918 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-99b1f40f-cbf3-4caf-b900-46cf25a7fbda tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:58.336516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-99b1f40f-cbf3-4caf-b900-46cf25a7fbda tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:58.344329 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-99b1f40f-cbf3-4caf-b900-46cf25a7fbda tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:58.344837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-99b1f40f-cbf3-4caf-b900-46cf25a7fbda tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:58.345697 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-99b1f40f-cbf3-4caf-b900-46cf25a7fbda tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:58.346181 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-99b1f40f-cbf3-4caf-b900-46cf25a7fbda tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:58.560680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-99b1f40f-cbf3-4caf-b900-46cf25a7fbda tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:58.569533 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-99b1f40f-cbf3-4caf-b900-46cf25a7fbda tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1678 microversion: 2.1 time: 0.237655 Feb 17 03:34:58.570135 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 468/924] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:58 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:34:59.588148 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-134c6f7d-a477-4131-a39c-53ad4ead09a5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:34:59.588961 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-134c6f7d-a477-4131-a39c-53ad4ead09a5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:34:59.596941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-134c6f7d-a477-4131-a39c-53ad4ead09a5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:59.597487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-134c6f7d-a477-4131-a39c-53ad4ead09a5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:59.598331 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-134c6f7d-a477-4131-a39c-53ad4ead09a5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:34:59.598824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-134c6f7d-a477-4131-a39c-53ad4ead09a5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:34:59.876134 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-134c6f7d-a477-4131-a39c-53ad4ead09a5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:34:59.885948 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-134c6f7d-a477-4131-a39c-53ad4ead09a5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1678 microversion: 2.1 time: 0.301932 Feb 17 03:34:59.886581 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 457/925] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:34:59 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1678 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:00.905240 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6d76e3f6-a930-468a-b32b-5d4977c9a6ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:00.906023 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6d76e3f6-a930-468a-b32b-5d4977c9a6ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:00.914018 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6d76e3f6-a930-468a-b32b-5d4977c9a6ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:00.914528 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6d76e3f6-a930-468a-b32b-5d4977c9a6ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:00.915363 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6d76e3f6-a930-468a-b32b-5d4977c9a6ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:00.915855 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6d76e3f6-a930-468a-b32b-5d4977c9a6ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:01.134858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6d76e3f6-a930-468a-b32b-5d4977c9a6ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:01.145134 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6d76e3f6-a930-468a-b32b-5d4977c9a6ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1678 microversion: 2.1 time: 0.244436 Feb 17 03:35:01.145836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 469/926] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:00 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1678 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:02.164115 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2b0cf67b-546d-4622-9f40-6d102e60c243 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:02.164705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2b0cf67b-546d-4622-9f40-6d102e60c243 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:02.172951 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2b0cf67b-546d-4622-9f40-6d102e60c243 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:02.173490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2b0cf67b-546d-4622-9f40-6d102e60c243 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:02.174316 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2b0cf67b-546d-4622-9f40-6d102e60c243 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:02.174803 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2b0cf67b-546d-4622-9f40-6d102e60c243 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:02.416460 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2b0cf67b-546d-4622-9f40-6d102e60c243 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:02.425714 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2b0cf67b-546d-4622-9f40-6d102e60c243 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1655 microversion: 2.1 time: 0.265664 Feb 17 03:35:02.426299 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 458/927] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:02 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1655 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:02.443216 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-61e83d0e-f0be-408d-ad21-670f67f4c62e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:02.451498 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-61e83d0e-f0be-408d-ad21-670f67f4c62e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:02.452009 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-61e83d0e-f0be-408d-ad21-670f67f4c62e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:02.514500 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-61e83d0e-f0be-408d-ad21-670f67f4c62e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Going to try to start instance {{(pid=98103) start /opt/stack/nova/nova/compute/api.py:2603}} Feb 17 03:35:02.597193 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-61e83d0e-f0be-408d-ad21-670f67f4c62e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action" status: 202 len: 0 microversion: 2.1 time: 0.157810 Feb 17 03:35:02.597865 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 470/928] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:35:02 2021] POST /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:35:02.606545 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6d6e690c-6642-47dd-9da9-f0e1a0b807ed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:02.607434 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6d6e690c-6642-47dd-9da9-f0e1a0b807ed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:02.615907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6d6e690c-6642-47dd-9da9-f0e1a0b807ed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:02.616416 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6d6e690c-6642-47dd-9da9-f0e1a0b807ed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:02.617334 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6d6e690c-6642-47dd-9da9-f0e1a0b807ed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:02.618023 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6d6e690c-6642-47dd-9da9-f0e1a0b807ed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:02.900647 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6d6e690c-6642-47dd-9da9-f0e1a0b807ed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:02.918107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6d6e690c-6642-47dd-9da9-f0e1a0b807ed tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1664 microversion: 2.1 time: 0.314935 Feb 17 03:35:02.919130 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 459/929] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:02 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1664 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:03.945985 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-17bcd3f4-a270-48c7-bb4b-0a8e3487d729 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:03.946756 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-17bcd3f4-a270-48c7-bb4b-0a8e3487d729 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:03.955623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-17bcd3f4-a270-48c7-bb4b-0a8e3487d729 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:03.956113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-17bcd3f4-a270-48c7-bb4b-0a8e3487d729 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:03.956956 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-17bcd3f4-a270-48c7-bb4b-0a8e3487d729 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:03.957474 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-17bcd3f4-a270-48c7-bb4b-0a8e3487d729 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:04.170531 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-17bcd3f4-a270-48c7-bb4b-0a8e3487d729 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:04.179442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-17bcd3f4-a270-48c7-bb4b-0a8e3487d729 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1664 microversion: 2.1 time: 0.238476 Feb 17 03:35:04.180053 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 471/930] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:03 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1664 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:05.198878 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d3215498-3328-47c7-a96f-bd96a87e68d5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:05.199550 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d3215498-3328-47c7-a96f-bd96a87e68d5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:05.207858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d3215498-3328-47c7-a96f-bd96a87e68d5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:05.208368 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d3215498-3328-47c7-a96f-bd96a87e68d5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:05.209406 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d3215498-3328-47c7-a96f-bd96a87e68d5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:05.209785 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d3215498-3328-47c7-a96f-bd96a87e68d5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:05.443604 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d3215498-3328-47c7-a96f-bd96a87e68d5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:05.452843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d3215498-3328-47c7-a96f-bd96a87e68d5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1668 microversion: 2.1 time: 0.258222 Feb 17 03:35:05.453481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 460/931] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:05 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1668 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:08.293826 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2e42f25b-ff16-46b8-9e36-e2d52a64c052 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:08.294362 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2e42f25b-ff16-46b8-9e36-e2d52a64c052 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:08.303095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e42f25b-ff16-46b8-9e36-e2d52a64c052 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:08.303592 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e42f25b-ff16-46b8-9e36-e2d52a64c052 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:08.304455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e42f25b-ff16-46b8-9e36-e2d52a64c052 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:08.304946 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e42f25b-ff16-46b8-9e36-e2d52a64c052 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:08.374107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2e42f25b-ff16-46b8-9e36-e2d52a64c052 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/os-volume_attachments/b916a0dc-1945-4563-9dc7-abffc97e1e94" status: 200 len: 194 microversion: 2.20 time: 0.084412 Feb 17 03:35:08.374747 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 472/932] 10.222.0.57 () {60 vars in 1444 bytes} [Wed Feb 17 03:35:08 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/os-volume_attachments/b916a0dc-1945-4563-9dc7-abffc97e1e94 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:35:08.489917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d223bf38-1a5b-4dd7-b3a3-26142a498c38 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:08.490406 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d223bf38-1a5b-4dd7-b3a3-26142a498c38 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:08.498268 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d223bf38-1a5b-4dd7-b3a3-26142a498c38 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:08.498785 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d223bf38-1a5b-4dd7-b3a3-26142a498c38 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:08.499623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d223bf38-1a5b-4dd7-b3a3-26142a498c38 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:08.500109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d223bf38-1a5b-4dd7-b3a3-26142a498c38 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:08.676514 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-d223bf38-1a5b-4dd7-b3a3-26142a498c38 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lazy-loading 'services' on Instance uuid 4840bec6-59fa-4a75-9cab-b8eba3fced9d {{(pid=98104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:35:08.821361 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d223bf38-1a5b-4dd7-b3a3-26142a498c38 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/os-volume_attachments/b916a0dc-1945-4563-9dc7-abffc97e1e94" status: 202 len: 0 microversion: 2.20 time: 0.335036 Feb 17 03:35:08.822209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 461/933] 10.222.0.57 () {60 vars in 1447 bytes} [Wed Feb 17 03:35:08 2021] DELETE /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d/os-volume_attachments/b916a0dc-1945-4563-9dc7-abffc97e1e94 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:35:10.046136 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1e29abf7-a92b-4c28-8bec-ec6198a4f36d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:10.046690 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1e29abf7-a92b-4c28-8bec-ec6198a4f36d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:10.055201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e29abf7-a92b-4c28-8bec-ec6198a4f36d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:10.055719 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e29abf7-a92b-4c28-8bec-ec6198a4f36d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:10.056623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e29abf7-a92b-4c28-8bec-ec6198a4f36d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:10.057234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e29abf7-a92b-4c28-8bec-ec6198a4f36d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:10.129234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1e29abf7-a92b-4c28-8bec-ec6198a4f36d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Going to try to terminate instance {{(pid=98103) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:35:10.258235 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1e29abf7-a92b-4c28-8bec-ec6198a4f36d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 204 len: 0 microversion: 2.20 time: 0.215816 Feb 17 03:35:10.259244 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 473/934] 10.222.0.57 () {60 vars in 1270 bytes} [Wed Feb 17 03:35:10 2021] DELETE /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 17 03:35:10.269865 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c1aa6454-0c5e-46c8-bb15-35b6a33b8670 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:10.270727 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c1aa6454-0c5e-46c8-bb15-35b6a33b8670 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:10.279026 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c1aa6454-0c5e-46c8-bb15-35b6a33b8670 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:10.280626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c1aa6454-0c5e-46c8-bb15-35b6a33b8670 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:10.281432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c1aa6454-0c5e-46c8-bb15-35b6a33b8670 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:10.281929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c1aa6454-0c5e-46c8-bb15-35b6a33b8670 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:10.522239 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c1aa6454-0c5e-46c8-bb15-35b6a33b8670 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:10.532637 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c1aa6454-0c5e-46c8-bb15-35b6a33b8670 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:10.534284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c1aa6454-0c5e-46c8-bb15-35b6a33b8670 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:10.535686 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c1aa6454-0c5e-46c8-bb15-35b6a33b8670 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1720 microversion: 2.20 time: 0.271419 Feb 17 03:35:10.536276 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 462/935] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:10 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1720 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:11.556450 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fd88b2aa-d8f2-49c1-ae0e-59ffa366f927 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:11.557552 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fd88b2aa-d8f2-49c1-ae0e-59ffa366f927 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:11.566089 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fd88b2aa-d8f2-49c1-ae0e-59ffa366f927 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:11.566614 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fd88b2aa-d8f2-49c1-ae0e-59ffa366f927 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:11.567563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fd88b2aa-d8f2-49c1-ae0e-59ffa366f927 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:11.568132 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fd88b2aa-d8f2-49c1-ae0e-59ffa366f927 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:11.803320 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-fd88b2aa-d8f2-49c1-ae0e-59ffa366f927 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:11.812925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-fd88b2aa-d8f2-49c1-ae0e-59ffa366f927 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:11.814562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-fd88b2aa-d8f2-49c1-ae0e-59ffa366f927 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:11.815771 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fd88b2aa-d8f2-49c1-ae0e-59ffa366f927 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1720 microversion: 2.20 time: 0.263873 Feb 17 03:35:11.816429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 474/936] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:11 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1720 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:12.836677 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fb8e00ae-c3b5-4971-9e4f-853492ead17f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:12.837956 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fb8e00ae-c3b5-4971-9e4f-853492ead17f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:12.847194 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fb8e00ae-c3b5-4971-9e4f-853492ead17f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:12.847963 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fb8e00ae-c3b5-4971-9e4f-853492ead17f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:12.859793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fb8e00ae-c3b5-4971-9e4f-853492ead17f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:12.860549 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fb8e00ae-c3b5-4971-9e4f-853492ead17f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:13.409777 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-fb8e00ae-c3b5-4971-9e4f-853492ead17f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:13.420136 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-fb8e00ae-c3b5-4971-9e4f-853492ead17f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:13.422109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-fb8e00ae-c3b5-4971-9e4f-853492ead17f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:13.423741 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fb8e00ae-c3b5-4971-9e4f-853492ead17f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1720 microversion: 2.20 time: 0.591142 Feb 17 03:35:13.424569 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 463/937] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:12 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1720 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:35:14.202714 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-a6871d47-ac5d-4f11-be96-00c4968b7d04 req-5faf7dc2-dba1-4e8d-8234-e810a4ec74be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4840bec6-59fa-4a75-9cab-b8eba3fced9d", "name": "network-vif-deleted", "tag": "3122eba0-b4d4-415e-b7c0-f67223c6ab3f"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:14.205284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:35:14.205284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:35:14.218317 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-a6871d47-ac5d-4f11-be96-00c4968b7d04 req-5faf7dc2-dba1-4e8d-8234-e810a4ec74be service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:14.219046 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-a6871d47-ac5d-4f11-be96-00c4968b7d04 req-5faf7dc2-dba1-4e8d-8234-e810a4ec74be service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:14.240693 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-a6871d47-ac5d-4f11-be96-00c4968b7d04 req-5faf7dc2-dba1-4e8d-8234-e810a4ec74be service nova] Creating event network-vif-deleted:3122eba0-b4d4-415e-b7c0-f67223c6ab3f for instance 4840bec6-59fa-4a75-9cab-b8eba3fced9d on hv-cinder-75994 Feb 17 03:35:14.246149 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-a6871d47-ac5d-4f11-be96-00c4968b7d04 req-5faf7dc2-dba1-4e8d-8234-e810a4ec74be service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047631 Feb 17 03:35:14.249826 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 475/938] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:35:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:35:14.444100 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c4dc46b3-88a5-49cb-9ce8-f914ee5e0af4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:14.444677 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c4dc46b3-88a5-49cb-9ce8-f914ee5e0af4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:14.454454 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c4dc46b3-88a5-49cb-9ce8-f914ee5e0af4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:14.455206 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c4dc46b3-88a5-49cb-9ce8-f914ee5e0af4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:14.456479 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c4dc46b3-88a5-49cb-9ce8-f914ee5e0af4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:14.457138 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c4dc46b3-88a5-49cb-9ce8-f914ee5e0af4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:14.542657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c4dc46b3-88a5-49cb-9ce8-f914ee5e0af4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:14.543415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c4dc46b3-88a5-49cb-9ce8-f914ee5e0af4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:14.544673 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-c4dc46b3-88a5-49cb-9ce8-f914ee5e0af4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lazy-loading 'fault' on Instance uuid 4840bec6-59fa-4a75-9cab-b8eba3fced9d {{(pid=98104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:35:14.686397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c4dc46b3-88a5-49cb-9ce8-f914ee5e0af4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:14.699499 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c4dc46b3-88a5-49cb-9ce8-f914ee5e0af4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:14.702522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c4dc46b3-88a5-49cb-9ce8-f914ee5e0af4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:14.705193 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c4dc46b3-88a5-49cb-9ce8-f914ee5e0af4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 200 len: 1370 microversion: 2.20 time: 0.265253 Feb 17 03:35:14.706325 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 464/939] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:14 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 1370 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:15.730103 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7aa19326-8968-46a9-8306-959513260497 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:15.730886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7aa19326-8968-46a9-8306-959513260497 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:15.740873 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7aa19326-8968-46a9-8306-959513260497 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:15.741463 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7aa19326-8968-46a9-8306-959513260497 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:15.742346 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7aa19326-8968-46a9-8306-959513260497 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:15.742843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7aa19326-8968-46a9-8306-959513260497 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:15.803539 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-7aa19326-8968-46a9-8306-959513260497 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] HTTP exception thrown: Instance 4840bec6-59fa-4a75-9cab-b8eba3fced9d could not be found. Feb 17 03:35:15.804356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7aa19326-8968-46a9-8306-959513260497 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Returning 404 to user: Instance 4840bec6-59fa-4a75-9cab-b8eba3fced9d could not be found. {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:35:15.805283 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7aa19326-8968-46a9-8306-959513260497 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 404 len: 111 microversion: 2.20 time: 0.079942 Feb 17 03:35:15.806088 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 476/940] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:15 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 17 03:35:15.817516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-38ab39f2-6279-4bab-b55a-dab5fe2e225e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '.version_select at 0x7f98b00c9378>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:15.844852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-38ab39f2-6279-4bab-b55a-dab5fe2e225e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-93764289" status: 204 len: 0 microversion: 2.20 time: 0.033701 Feb 17 03:35:15.845550 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 465/941] 10.222.0.57 () {60 vars in 1246 bytes} [Wed Feb 17 03:35:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-93764289 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 17 03:35:19.055408 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2612fe6e-9009-4e34-b620-03dea1c47804 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'create', calling method: .version_select at 0x7f98b04161e0>, body: {"keypair": {"name": "tempest-keypair-2054237630"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:19.101323 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-2612fe6e-9009-4e34-b620-03dea1c47804 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Getting quotas for project 64044155addf41e9ba2bde5782afed2a. Resources: {'key_pairs'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:35:19.106505 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-2612fe6e-9009-4e34-b620-03dea1c47804 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Getting quotas for user d89f687506dc43c6b64ec46ad1396b2e and project 64044155addf41e9ba2bde5782afed2a. Resources: {'key_pairs'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:35:19.537013 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-2612fe6e-9009-4e34-b620-03dea1c47804 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Getting quotas for project 64044155addf41e9ba2bde5782afed2a. Resources: {'key_pairs'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:35:19.541391 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-2612fe6e-9009-4e34-b620-03dea1c47804 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Getting quotas for user d89f687506dc43c6b64ec46ad1396b2e and project 64044155addf41e9ba2bde5782afed2a. Resources: {'key_pairs'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:35:19.557562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2612fe6e-9009-4e34-b620-03dea1c47804 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.508119 Feb 17 03:35:19.558233 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 477/942] 10.222.0.57 () {62 vars in 1189 bytes} [Wed Feb 17 03:35:19 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 510 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 17 03:35:22.651769 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-47e32ab1-8802-4fce-878c-e19aa023b5d3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2002270759", "imageRef": "27891a64-31b3-4754-87b4-bf609a12c59a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "735791d7-b752-470f-b049-6623a91713f5"}], "security_groups": [{"name": "tempest-securitygroup--964205925"}], "key_name": "tempest-keypair-2054237630", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:22.829555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-47e32ab1-8802-4fce-878c-e19aa023b5d3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] validate_networks() for [('735791d7-b752-470f-b049-6623a91713f5', None, None, None)] {{(pid=98104) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:35:23.530711 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-47e32ab1-8802-4fce-878c-e19aa023b5d3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Flavor limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:35:23.531384 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-47e32ab1-8802-4fce-878c-e19aa023b5d3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Image limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:35:23.532063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-47e32ab1-8802-4fce-878c-e19aa023b5d3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Flavor pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:35:23.532538 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-47e32ab1-8802-4fce-878c-e19aa023b5d3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Image pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:35:23.533372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-47e32ab1-8802-4fce-878c-e19aa023b5d3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:35:23.542827 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-47e32ab1-8802-4fce-878c-e19aa023b5d3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:23.543330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-47e32ab1-8802-4fce-878c-e19aa023b5d3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:23.544224 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-47e32ab1-8802-4fce-878c-e19aa023b5d3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:23.545874 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-47e32ab1-8802-4fce-878c-e19aa023b5d3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:23.571588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-47e32ab1-8802-4fce-878c-e19aa023b5d3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Getting quotas for project 64044155addf41e9ba2bde5782afed2a. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:35:23.577276 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-47e32ab1-8802-4fce-878c-e19aa023b5d3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Getting quotas for user d89f687506dc43c6b64ec46ad1396b2e and project 64044155addf41e9ba2bde5782afed2a. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:35:23.591252 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-47e32ab1-8802-4fce-878c-e19aa023b5d3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Going to run 1 instances... {{(pid=98104) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:35:23.594798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-47e32ab1-8802-4fce-878c-e19aa023b5d3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27891a64-31b3-4754-87b4-bf609a12c59a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:35:23.658663 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-47e32ab1-8802-4fce-878c-e19aa023b5d3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.011325 Feb 17 03:35:23.659697 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 466/943] 10.222.0.57 () {62 vars in 1178 bytes} [Wed Feb 17 03:35:22 2021] POST /compute/v2.1/servers => generated 401 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 17 03:35:23.671061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-151eb0d7-890e-4135-b557-bcaae3253a16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:23.671934 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-151eb0d7-890e-4135-b557-bcaae3253a16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:23.792069 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-151eb0d7-890e-4135-b557-bcaae3253a16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:23.812970 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-151eb0d7-890e-4135-b557-bcaae3253a16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:23.821007 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-151eb0d7-890e-4135-b557-bcaae3253a16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:23.823589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-151eb0d7-890e-4135-b557-bcaae3253a16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1282 microversion: 2.20 time: 0.156501 Feb 17 03:35:23.825021 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 478/944] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:23 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1282 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:24.866756 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3f7bb1fe-b9df-448f-90eb-22f1290703c2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:24.868886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3f7bb1fe-b9df-448f-90eb-22f1290703c2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:24.910841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3f7bb1fe-b9df-448f-90eb-22f1290703c2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:24.911952 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3f7bb1fe-b9df-448f-90eb-22f1290703c2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:24.919298 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3f7bb1fe-b9df-448f-90eb-22f1290703c2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:24.921009 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3f7bb1fe-b9df-448f-90eb-22f1290703c2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:25.108703 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3f7bb1fe-b9df-448f-90eb-22f1290703c2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:25.124428 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3f7bb1fe-b9df-448f-90eb-22f1290703c2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:25.127745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3f7bb1fe-b9df-448f-90eb-22f1290703c2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:25.130486 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3f7bb1fe-b9df-448f-90eb-22f1290703c2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1286 microversion: 2.20 time: 0.272283 Feb 17 03:35:25.144756 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 467/945] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:24 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1286 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:26.172130 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6d8a3296-9c8f-4700-afa3-a79e287a2987 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:26.172927 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6d8a3296-9c8f-4700-afa3-a79e287a2987 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:26.237155 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6d8a3296-9c8f-4700-afa3-a79e287a2987 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:26.237702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6d8a3296-9c8f-4700-afa3-a79e287a2987 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:26.238587 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6d8a3296-9c8f-4700-afa3-a79e287a2987 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:26.239087 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6d8a3296-9c8f-4700-afa3-a79e287a2987 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:26.620562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6d8a3296-9c8f-4700-afa3-a79e287a2987 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:26.633236 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6d8a3296-9c8f-4700-afa3-a79e287a2987 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:26.635183 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6d8a3296-9c8f-4700-afa3-a79e287a2987 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:26.636665 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6d8a3296-9c8f-4700-afa3-a79e287a2987 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1342 microversion: 2.20 time: 0.485286 Feb 17 03:35:26.637511 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 479/946] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:26 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1342 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:27.668449 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-60228768-3b79-4a74-af6c-954b779e19b8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:27.669508 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-60228768-3b79-4a74-af6c-954b779e19b8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:27.694420 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-60228768-3b79-4a74-af6c-954b779e19b8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:27.694911 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-60228768-3b79-4a74-af6c-954b779e19b8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:27.696230 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-60228768-3b79-4a74-af6c-954b779e19b8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:27.696887 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-60228768-3b79-4a74-af6c-954b779e19b8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:27.926511 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-60228768-3b79-4a74-af6c-954b779e19b8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:27.938701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-60228768-3b79-4a74-af6c-954b779e19b8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:27.952356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-60228768-3b79-4a74-af6c-954b779e19b8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:27.954546 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-60228768-3b79-4a74-af6c-954b779e19b8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1340 microversion: 2.20 time: 0.290923 Feb 17 03:35:27.969575 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 468/947] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:27 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1340 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:28.984594 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8f4627b5-b2d7-441a-a07c-4eb83a52c553 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:28.985910 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8f4627b5-b2d7-441a-a07c-4eb83a52c553 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:28.998797 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f4627b5-b2d7-441a-a07c-4eb83a52c553 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:29.012291 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f4627b5-b2d7-441a-a07c-4eb83a52c553 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:29.013226 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f4627b5-b2d7-441a-a07c-4eb83a52c553 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:29.013957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f4627b5-b2d7-441a-a07c-4eb83a52c553 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:29.369313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8f4627b5-b2d7-441a-a07c-4eb83a52c553 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:29.406884 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8f4627b5-b2d7-441a-a07c-4eb83a52c553 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:29.410746 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8f4627b5-b2d7-441a-a07c-4eb83a52c553 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:29.412315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8f4627b5-b2d7-441a-a07c-4eb83a52c553 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1407 microversion: 2.20 time: 0.432381 Feb 17 03:35:29.414881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 480/948] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:28 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1407 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:35:30.438141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-02bbedb7-d9de-438c-b2c1-7ef98c00fabe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:30.438943 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-02bbedb7-d9de-438c-b2c1-7ef98c00fabe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:30.457051 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-02bbedb7-d9de-438c-b2c1-7ef98c00fabe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:30.457584 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-02bbedb7-d9de-438c-b2c1-7ef98c00fabe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:30.458463 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-02bbedb7-d9de-438c-b2c1-7ef98c00fabe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:30.458962 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-02bbedb7-d9de-438c-b2c1-7ef98c00fabe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:31.068783 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-91bdc370-c61f-4bef-8a00-824ed72609b4 req-203eabb2-77ee-417a-b40e-f9ab64a3683e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb13b0aa-8bce-4878-943d-e3483a430b36", "tag": "3536cbed-2c8d-4d95-bbc0-f2840e848748"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:31.071038 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:35:31.071038 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:35:31.089462 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-91bdc370-c61f-4bef-8a00-824ed72609b4 req-203eabb2-77ee-417a-b40e-f9ab64a3683e service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:31.094888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-91bdc370-c61f-4bef-8a00-824ed72609b4 req-203eabb2-77ee-417a-b40e-f9ab64a3683e service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:31.133338 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-91bdc370-c61f-4bef-8a00-824ed72609b4 req-203eabb2-77ee-417a-b40e-f9ab64a3683e service nova] Creating event network-changed:3536cbed-2c8d-4d95-bbc0-f2840e848748 for instance eb13b0aa-8bce-4878-943d-e3483a430b36 on hv-cinder-75994 Feb 17 03:35:31.140549 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-91bdc370-c61f-4bef-8a00-824ed72609b4 req-203eabb2-77ee-417a-b40e-f9ab64a3683e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075507 Feb 17 03:35:31.141861 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 481/949] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:35:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:35:31.221580 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-02bbedb7-d9de-438c-b2c1-7ef98c00fabe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:31.237600 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-02bbedb7-d9de-438c-b2c1-7ef98c00fabe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:31.243705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-02bbedb7-d9de-438c-b2c1-7ef98c00fabe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:31.251521 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-02bbedb7-d9de-438c-b2c1-7ef98c00fabe tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1407 microversion: 2.20 time: 0.818671 Feb 17 03:35:31.252359 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 469/950] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:30 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1407 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:35:32.277437 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2ecc4a67-3b3e-471d-b8e3-405676f6cc96 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:32.280591 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2ecc4a67-3b3e-471d-b8e3-405676f6cc96 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:32.298270 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ecc4a67-3b3e-471d-b8e3-405676f6cc96 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:32.299091 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ecc4a67-3b3e-471d-b8e3-405676f6cc96 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:32.299951 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ecc4a67-3b3e-471d-b8e3-405676f6cc96 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:32.300504 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ecc4a67-3b3e-471d-b8e3-405676f6cc96 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:32.571991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2ecc4a67-3b3e-471d-b8e3-405676f6cc96 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:32.586908 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2ecc4a67-3b3e-471d-b8e3-405676f6cc96 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:32.588597 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2ecc4a67-3b3e-471d-b8e3-405676f6cc96 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:32.589860 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2ecc4a67-3b3e-471d-b8e3-405676f6cc96 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1407 microversion: 2.20 time: 0.322235 Feb 17 03:35:32.590664 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 482/951] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:32 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:32.643408 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f6be69f0-bf94-4a64-aca1-c6dd44303751 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Action: 'create', calling method: .version_select at 0x7f98b00c9950>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1289814794"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:32.671438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-f6be69f0-bf94-4a64-aca1-c6dd44303751 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Getting quotas for project 688dfe990479484ba91f5f3241f71c34. Resources: {'key_pairs'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:35:32.677109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-f6be69f0-bf94-4a64-aca1-c6dd44303751 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Getting quotas for user fbaea093d10841038a9e1cf700d5e2ae and project 688dfe990479484ba91f5f3241f71c34. Resources: {'key_pairs'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:35:32.946791 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-f6be69f0-bf94-4a64-aca1-c6dd44303751 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Getting quotas for project 688dfe990479484ba91f5f3241f71c34. Resources: {'key_pairs'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:35:32.950966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-f6be69f0-bf94-4a64-aca1-c6dd44303751 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Getting quotas for user fbaea093d10841038a9e1cf700d5e2ae and project 688dfe990479484ba91f5f3241f71c34. Resources: {'key_pairs'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:35:32.966473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f6be69f0-bf94-4a64-aca1-c6dd44303751 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.327409 Feb 17 03:35:32.978462 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 470/952] 10.222.0.57 () {60 vars in 1148 bytes} [Wed Feb 17 03:35:32 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:33.026662 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-24ef21bb-2fd0-4612-8d29-3c8c53237b9b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-76790268", "imageRef": "882e6a5e-0aa2-4af8-8a73-25f96c540011", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1289814794", "networks": [{"uuid": "b3188410-3b2d-4523-8ccc-1882d94255cc"}]}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:33.099966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-24ef21bb-2fd0-4612-8d29-3c8c53237b9b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] validate_networks() for [('b3188410-3b2d-4523-8ccc-1882d94255cc', None, None, None)] {{(pid=98103) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:35:33.611833 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ceb7e4ad-9915-45d9-b9a2-ddf21b6fcdb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:33.612404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ceb7e4ad-9915-45d9-b9a2-ddf21b6fcdb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:33.620603 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ceb7e4ad-9915-45d9-b9a2-ddf21b6fcdb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:33.621148 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ceb7e4ad-9915-45d9-b9a2-ddf21b6fcdb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:33.622029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ceb7e4ad-9915-45d9-b9a2-ddf21b6fcdb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:33.622509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ceb7e4ad-9915-45d9-b9a2-ddf21b6fcdb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:33.797365 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-24ef21bb-2fd0-4612-8d29-3c8c53237b9b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:35:33.797840 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-24ef21bb-2fd0-4612-8d29-3c8c53237b9b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:35:33.798379 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-24ef21bb-2fd0-4612-8d29-3c8c53237b9b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:35:33.798838 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-24ef21bb-2fd0-4612-8d29-3c8c53237b9b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:35:33.799299 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-24ef21bb-2fd0-4612-8d29-3c8c53237b9b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:35:33.808811 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-24ef21bb-2fd0-4612-8d29-3c8c53237b9b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:33.809364 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-24ef21bb-2fd0-4612-8d29-3c8c53237b9b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:33.810240 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-24ef21bb-2fd0-4612-8d29-3c8c53237b9b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:33.810726 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-24ef21bb-2fd0-4612-8d29-3c8c53237b9b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:33.830579 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-24ef21bb-2fd0-4612-8d29-3c8c53237b9b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Getting quotas for project 688dfe990479484ba91f5f3241f71c34. Resources: {'ram', 'cores', 'instances'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:35:33.835543 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-24ef21bb-2fd0-4612-8d29-3c8c53237b9b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Getting quotas for user fbaea093d10841038a9e1cf700d5e2ae and project 688dfe990479484ba91f5f3241f71c34. Resources: {'ram', 'cores', 'instances'} {{(pid=98103) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:35:33.849642 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-24ef21bb-2fd0-4612-8d29-3c8c53237b9b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Going to run 1 instances... {{(pid=98103) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:35:33.851171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ceb7e4ad-9915-45d9-b9a2-ddf21b6fcdb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:33.852100 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-24ef21bb-2fd0-4612-8d29-3c8c53237b9b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882e6a5e-0aa2-4af8-8a73-25f96c540011',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:35:33.863198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ceb7e4ad-9915-45d9-b9a2-ddf21b6fcdb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:33.865159 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ceb7e4ad-9915-45d9-b9a2-ddf21b6fcdb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:33.866540 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ceb7e4ad-9915-45d9-b9a2-ddf21b6fcdb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1407 microversion: 2.20 time: 0.259656 Feb 17 03:35:33.867364 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 471/953] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:33 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:35:33.907352 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-24ef21bb-2fd0-4612-8d29-3c8c53237b9b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.884749 Feb 17 03:35:33.908073 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 483/954] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:35:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:35:33.919032 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2cfb7bea-9980-40ba-8fb3-26deff6220ba tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:33.919713 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2cfb7bea-9980-40ba-8fb3-26deff6220ba tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:34.006619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2cfb7bea-9980-40ba-8fb3-26deff6220ba tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:34.015791 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2cfb7bea-9980-40ba-8fb3-26deff6220ba tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1257 microversion: 2.1 time: 0.100943 Feb 17 03:35:34.016430 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 472/955] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:33 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1257 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:34.892302 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1fe4b96b-b3b1-477b-b380-d74794c0e463 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:34.892974 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1fe4b96b-b3b1-477b-b380-d74794c0e463 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:34.901577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1fe4b96b-b3b1-477b-b380-d74794c0e463 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:34.902081 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1fe4b96b-b3b1-477b-b380-d74794c0e463 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:34.902930 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1fe4b96b-b3b1-477b-b380-d74794c0e463 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:34.903422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1fe4b96b-b3b1-477b-b380-d74794c0e463 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:35.034729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9688559c-942f-480d-b8c5-07665bbd10b7 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:35.035671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9688559c-942f-480d-b8c5-07665bbd10b7 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:35.044591 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9688559c-942f-480d-b8c5-07665bbd10b7 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:35.045352 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9688559c-942f-480d-b8c5-07665bbd10b7 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:35.046336 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9688559c-942f-480d-b8c5-07665bbd10b7 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:35.046963 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9688559c-942f-480d-b8c5-07665bbd10b7 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:35.131121 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1fe4b96b-b3b1-477b-b380-d74794c0e463 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:35.141881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1fe4b96b-b3b1-477b-b380-d74794c0e463 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:35.143558 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1fe4b96b-b3b1-477b-b380-d74794c0e463 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:35.144755 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1fe4b96b-b3b1-477b-b380-d74794c0e463 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1407 microversion: 2.20 time: 0.257176 Feb 17 03:35:35.145608 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 484/956] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:34 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:35.270126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9688559c-942f-480d-b8c5-07665bbd10b7 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:35.280646 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9688559c-942f-480d-b8c5-07665bbd10b7 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1309 microversion: 2.1 time: 0.250043 Feb 17 03:35:35.281514 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 473/957] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:35 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1309 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:35:35.318319 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d084f8d0-5ded-4544-88f2-38db58041ba8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:35.318941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d084f8d0-5ded-4544-88f2-38db58041ba8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:35.327360 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d084f8d0-5ded-4544-88f2-38db58041ba8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:35.327871 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d084f8d0-5ded-4544-88f2-38db58041ba8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:35.328729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d084f8d0-5ded-4544-88f2-38db58041ba8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:35.329306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d084f8d0-5ded-4544-88f2-38db58041ba8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:35.402046 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d084f8d0-5ded-4544-88f2-38db58041ba8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Going to try to terminate instance {{(pid=98103) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:35:35.532434 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d084f8d0-5ded-4544-88f2-38db58041ba8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 204 len: 0 microversion: 2.1 time: 0.217795 Feb 17 03:35:35.537117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 485/958] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:35:35 2021] DELETE /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:35:35.543173 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9ccf4cda-bb5a-4d1d-b0fd-13d6762322bc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:35.550379 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9ccf4cda-bb5a-4d1d-b0fd-13d6762322bc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:35.553067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9ccf4cda-bb5a-4d1d-b0fd-13d6762322bc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:35.553595 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9ccf4cda-bb5a-4d1d-b0fd-13d6762322bc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:35.554525 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9ccf4cda-bb5a-4d1d-b0fd-13d6762322bc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:35.555027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9ccf4cda-bb5a-4d1d-b0fd-13d6762322bc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:36.074407 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9ccf4cda-bb5a-4d1d-b0fd-13d6762322bc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:36.087258 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9ccf4cda-bb5a-4d1d-b0fd-13d6762322bc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1583 microversion: 2.1 time: 0.549398 Feb 17 03:35:36.087858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 474/959] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:35 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1583 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:36.165763 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-29852a1d-d5a6-4e50-bb56-9f30c708700c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:36.166764 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-29852a1d-d5a6-4e50-bb56-9f30c708700c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:36.176431 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-29852a1d-d5a6-4e50-bb56-9f30c708700c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:36.176929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-29852a1d-d5a6-4e50-bb56-9f30c708700c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:36.177860 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-29852a1d-d5a6-4e50-bb56-9f30c708700c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:36.178506 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-29852a1d-d5a6-4e50-bb56-9f30c708700c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:36.300411 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f171c66c-f175-4220-b377-9d1c58258df1 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:36.301391 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f171c66c-f175-4220-b377-9d1c58258df1 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:36.310078 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f171c66c-f175-4220-b377-9d1c58258df1 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:36.310743 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f171c66c-f175-4220-b377-9d1c58258df1 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:36.311817 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f171c66c-f175-4220-b377-9d1c58258df1 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:36.312625 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f171c66c-f175-4220-b377-9d1c58258df1 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:36.470713 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f171c66c-f175-4220-b377-9d1c58258df1 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:36.472566 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-29852a1d-d5a6-4e50-bb56-9f30c708700c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:36.481505 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f171c66c-f175-4220-b377-9d1c58258df1 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1315 microversion: 2.1 time: 0.185906 Feb 17 03:35:36.482421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 475/960] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:36 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:36.494602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-29852a1d-d5a6-4e50-bb56-9f30c708700c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:36.496300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-29852a1d-d5a6-4e50-bb56-9f30c708700c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:36.497455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-29852a1d-d5a6-4e50-bb56-9f30c708700c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1407 microversion: 2.20 time: 0.336843 Feb 17 03:35:36.498054 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 486/961] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:36 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1407 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:37.109188 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-61e8c4cc-3bc0-48d0-b618-242d35dc6f50 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:37.111680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-61e8c4cc-3bc0-48d0-b618-242d35dc6f50 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:37.122459 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-61e8c4cc-3bc0-48d0-b618-242d35dc6f50 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:37.122977 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-61e8c4cc-3bc0-48d0-b618-242d35dc6f50 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:37.123883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-61e8c4cc-3bc0-48d0-b618-242d35dc6f50 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:37.124379 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-61e8c4cc-3bc0-48d0-b618-242d35dc6f50 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:37.369832 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-61e8c4cc-3bc0-48d0-b618-242d35dc6f50 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:37.379192 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-61e8c4cc-3bc0-48d0-b618-242d35dc6f50 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1583 microversion: 2.1 time: 0.276176 Feb 17 03:35:37.379786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 476/962] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:37 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1583 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:37.500716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8c7a6762-798f-4c2d-aeb6-f1b61d628fff tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:37.501493 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8c7a6762-798f-4c2d-aeb6-f1b61d628fff tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:37.509682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8c7a6762-798f-4c2d-aeb6-f1b61d628fff tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:37.510197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8c7a6762-798f-4c2d-aeb6-f1b61d628fff tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:37.511048 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8c7a6762-798f-4c2d-aeb6-f1b61d628fff tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:37.511532 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8c7a6762-798f-4c2d-aeb6-f1b61d628fff tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:37.520843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3a53039e-577e-461f-9095-35c8fa08ca82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:37.521931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3a53039e-577e-461f-9095-35c8fa08ca82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:37.534605 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3a53039e-577e-461f-9095-35c8fa08ca82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:37.535119 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3a53039e-577e-461f-9095-35c8fa08ca82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:37.535982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3a53039e-577e-461f-9095-35c8fa08ca82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:37.536476 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3a53039e-577e-461f-9095-35c8fa08ca82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:37.792542 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3a53039e-577e-461f-9095-35c8fa08ca82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:37.794535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8c7a6762-798f-4c2d-aeb6-f1b61d628fff tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:37.810688 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3a53039e-577e-461f-9095-35c8fa08ca82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:37.811907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8c7a6762-798f-4c2d-aeb6-f1b61d628fff tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1357 microversion: 2.1 time: 0.314109 Feb 17 03:35:37.812840 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3a53039e-577e-461f-9095-35c8fa08ca82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:37.814195 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 487/963] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:37 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1357 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:37.814380 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3a53039e-577e-461f-9095-35c8fa08ca82 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1407 microversion: 2.20 time: 0.299065 Feb 17 03:35:37.817132 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 477/964] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:37 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:35:38.398907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-069fb5a9-9fd6-4b40-871c-e12e9ac44a9a tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:38.399603 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-069fb5a9-9fd6-4b40-871c-e12e9ac44a9a tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:38.408965 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-069fb5a9-9fd6-4b40-871c-e12e9ac44a9a tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:38.409513 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-069fb5a9-9fd6-4b40-871c-e12e9ac44a9a tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:38.410380 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-069fb5a9-9fd6-4b40-871c-e12e9ac44a9a tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:38.410877 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-069fb5a9-9fd6-4b40-871c-e12e9ac44a9a tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:38.513108 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-6bcefb2f-156c-4c48-a0ce-ed1a4c6faa2c req-dab62d57-9d34-403c-b9db-5c61a925b245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb13b0aa-8bce-4878-943d-e3483a430b36", "name": "network-vif-plugged", "status": "completed", "tag": "3536cbed-2c8d-4d95-bbc0-f2840e848748"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:38.516841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:35:38.516841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:35:38.532125 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-6bcefb2f-156c-4c48-a0ce-ed1a4c6faa2c req-dab62d57-9d34-403c-b9db-5c61a925b245 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:38.533206 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-6bcefb2f-156c-4c48-a0ce-ed1a4c6faa2c req-dab62d57-9d34-403c-b9db-5c61a925b245 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:38.563876 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-6bcefb2f-156c-4c48-a0ce-ed1a4c6faa2c req-dab62d57-9d34-403c-b9db-5c61a925b245 service nova] Creating event network-vif-plugged:3536cbed-2c8d-4d95-bbc0-f2840e848748 for instance eb13b0aa-8bce-4878-943d-e3483a430b36 on hv-cinder-75994 Feb 17 03:35:38.570029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-6bcefb2f-156c-4c48-a0ce-ed1a4c6faa2c req-dab62d57-9d34-403c-b9db-5c61a925b245 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060925 Feb 17 03:35:38.570701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 478/965] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:35:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:35:38.676449 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-069fb5a9-9fd6-4b40-871c-e12e9ac44a9a tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:38.688223 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-069fb5a9-9fd6-4b40-871c-e12e9ac44a9a tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1583 microversion: 2.1 time: 0.293562 Feb 17 03:35:38.688831 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 488/966] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:38 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1583 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:38.833398 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8a6f728b-d4a4-43cb-b778-7ec50be436b0 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:38.834092 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8a6f728b-d4a4-43cb-b778-7ec50be436b0 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:38.842348 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-22271249-9dde-4e98-b253-f75ab0ad58b1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:38.843063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-22271249-9dde-4e98-b253-f75ab0ad58b1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:38.845096 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a6f728b-d4a4-43cb-b778-7ec50be436b0 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:38.845749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a6f728b-d4a4-43cb-b778-7ec50be436b0 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:38.846746 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a6f728b-d4a4-43cb-b778-7ec50be436b0 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:38.847354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a6f728b-d4a4-43cb-b778-7ec50be436b0 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:38.863823 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-22271249-9dde-4e98-b253-f75ab0ad58b1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:38.864329 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-22271249-9dde-4e98-b253-f75ab0ad58b1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:38.865224 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-22271249-9dde-4e98-b253-f75ab0ad58b1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:38.865713 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-22271249-9dde-4e98-b253-f75ab0ad58b1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:39.110331 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8a6f728b-d4a4-43cb-b778-7ec50be436b0 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:39.119477 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8a6f728b-d4a4-43cb-b778-7ec50be436b0 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1357 microversion: 2.1 time: 0.290905 Feb 17 03:35:39.120093 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 479/967] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:38 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1357 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:39.124582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-22271249-9dde-4e98-b253-f75ab0ad58b1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:39.134152 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-22271249-9dde-4e98-b253-f75ab0ad58b1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:39.135910 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-22271249-9dde-4e98-b253-f75ab0ad58b1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:39.137067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-22271249-9dde-4e98-b253-f75ab0ad58b1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1407 microversion: 2.20 time: 0.306425 Feb 17 03:35:39.137647 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 489/968] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:38 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:35:39.715717 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-066db525-e318-4df3-9a23-fe8d3a6c0002 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:39.722971 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-066db525-e318-4df3-9a23-fe8d3a6c0002 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:39.724615 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-066db525-e318-4df3-9a23-fe8d3a6c0002 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:39.725271 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-066db525-e318-4df3-9a23-fe8d3a6c0002 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:39.726090 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-066db525-e318-4df3-9a23-fe8d3a6c0002 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:39.726570 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-066db525-e318-4df3-9a23-fe8d3a6c0002 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:39.976495 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-066db525-e318-4df3-9a23-fe8d3a6c0002 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:39.986591 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-066db525-e318-4df3-9a23-fe8d3a6c0002 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1583 microversion: 2.1 time: 0.276388 Feb 17 03:35:39.987258 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 480/969] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:39 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1583 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:40.138306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8b4e99bb-ef1f-4290-9c9b-9a269a4341a8 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:40.138996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8b4e99bb-ef1f-4290-9c9b-9a269a4341a8 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:40.147499 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8b4e99bb-ef1f-4290-9c9b-9a269a4341a8 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:40.148125 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8b4e99bb-ef1f-4290-9c9b-9a269a4341a8 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:40.149083 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8b4e99bb-ef1f-4290-9c9b-9a269a4341a8 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:40.149702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8b4e99bb-ef1f-4290-9c9b-9a269a4341a8 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:40.159224 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d074603e-e517-44c9-8823-d45181b6385d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:40.159893 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d074603e-e517-44c9-8823-d45181b6385d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:40.171795 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d074603e-e517-44c9-8823-d45181b6385d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:40.172237 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d074603e-e517-44c9-8823-d45181b6385d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:40.173186 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d074603e-e517-44c9-8823-d45181b6385d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:40.173723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d074603e-e517-44c9-8823-d45181b6385d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:40.394340 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8b4e99bb-ef1f-4290-9c9b-9a269a4341a8 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:40.403878 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8b4e99bb-ef1f-4290-9c9b-9a269a4341a8 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1357 microversion: 2.1 time: 0.269507 Feb 17 03:35:40.405365 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 490/970] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:40 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1357 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:40.449605 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d074603e-e517-44c9-8823-d45181b6385d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:40.459912 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d074603e-e517-44c9-8823-d45181b6385d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:40.461549 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d074603e-e517-44c9-8823-d45181b6385d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:40.462732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d074603e-e517-44c9-8823-d45181b6385d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1407 microversion: 2.20 time: 0.308294 Feb 17 03:35:40.463309 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 481/971] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:40 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:41.009487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c6b7c3c4-5aab-4880-a82d-0937a1fa3020 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:41.011306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c6b7c3c4-5aab-4880-a82d-0937a1fa3020 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:41.020757 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c6b7c3c4-5aab-4880-a82d-0937a1fa3020 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:41.021300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c6b7c3c4-5aab-4880-a82d-0937a1fa3020 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:41.022171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c6b7c3c4-5aab-4880-a82d-0937a1fa3020 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:41.022647 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c6b7c3c4-5aab-4880-a82d-0937a1fa3020 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:41.261600 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c6b7c3c4-5aab-4880-a82d-0937a1fa3020 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:41.273652 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c6b7c3c4-5aab-4880-a82d-0937a1fa3020 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1583 microversion: 2.1 time: 0.271234 Feb 17 03:35:41.274270 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 491/972] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:41 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1583 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:41.423952 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5f4c367a-3660-4aaf-88e0-f26e4784d1ba tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:41.425527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5f4c367a-3660-4aaf-88e0-f26e4784d1ba tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:41.438015 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f4c367a-3660-4aaf-88e0-f26e4784d1ba tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:41.438852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f4c367a-3660-4aaf-88e0-f26e4784d1ba tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:41.439896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f4c367a-3660-4aaf-88e0-f26e4784d1ba tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:41.440542 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f4c367a-3660-4aaf-88e0-f26e4784d1ba tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:41.483044 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f27220dd-e803-4679-ae8d-db1be5c519df tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:41.483647 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f27220dd-e803-4679-ae8d-db1be5c519df tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:41.504582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f27220dd-e803-4679-ae8d-db1be5c519df tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:41.505112 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f27220dd-e803-4679-ae8d-db1be5c519df tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:41.505974 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f27220dd-e803-4679-ae8d-db1be5c519df tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:41.506459 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f27220dd-e803-4679-ae8d-db1be5c519df tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:41.712689 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5f4c367a-3660-4aaf-88e0-f26e4784d1ba tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:41.724801 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5f4c367a-3660-4aaf-88e0-f26e4784d1ba tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1357 microversion: 2.1 time: 0.305968 Feb 17 03:35:41.725481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 482/973] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:41 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1357 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:41.774202 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f27220dd-e803-4679-ae8d-db1be5c519df tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:41.784705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f27220dd-e803-4679-ae8d-db1be5c519df tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:41.786631 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f27220dd-e803-4679-ae8d-db1be5c519df tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:41.787900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f27220dd-e803-4679-ae8d-db1be5c519df tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1407 microversion: 2.20 time: 0.309504 Feb 17 03:35:41.788579 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 492/974] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:41 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:35:42.294280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f330c771-9a5f-4c81-be1f-7b8943ed384d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:42.295524 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f330c771-9a5f-4c81-be1f-7b8943ed384d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:42.305393 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f330c771-9a5f-4c81-be1f-7b8943ed384d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:42.305904 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f330c771-9a5f-4c81-be1f-7b8943ed384d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:42.306824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f330c771-9a5f-4c81-be1f-7b8943ed384d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:42.307322 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f330c771-9a5f-4c81-be1f-7b8943ed384d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:42.558000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f330c771-9a5f-4c81-be1f-7b8943ed384d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:42.568413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f330c771-9a5f-4c81-be1f-7b8943ed384d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1583 microversion: 2.1 time: 0.280159 Feb 17 03:35:42.569246 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 483/975] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:42 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1583 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:42.744014 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5d159dd5-8df3-49a7-8d7d-2d8e5ac407f5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:42.744837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5d159dd5-8df3-49a7-8d7d-2d8e5ac407f5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:42.754149 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5d159dd5-8df3-49a7-8d7d-2d8e5ac407f5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:42.754658 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5d159dd5-8df3-49a7-8d7d-2d8e5ac407f5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:42.755743 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5d159dd5-8df3-49a7-8d7d-2d8e5ac407f5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:42.756300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5d159dd5-8df3-49a7-8d7d-2d8e5ac407f5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:42.809058 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3427cf31-4f7b-42e9-8d25-f5cc70a2ed52 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:42.810296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3427cf31-4f7b-42e9-8d25-f5cc70a2ed52 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:42.819730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3427cf31-4f7b-42e9-8d25-f5cc70a2ed52 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:42.820343 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3427cf31-4f7b-42e9-8d25-f5cc70a2ed52 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:42.821578 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3427cf31-4f7b-42e9-8d25-f5cc70a2ed52 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:42.822147 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3427cf31-4f7b-42e9-8d25-f5cc70a2ed52 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:42.994590 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5d159dd5-8df3-49a7-8d7d-2d8e5ac407f5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:43.004505 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5d159dd5-8df3-49a7-8d7d-2d8e5ac407f5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1357 microversion: 2.1 time: 0.264362 Feb 17 03:35:43.005112 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 493/976] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:42 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1357 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:43.076300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3427cf31-4f7b-42e9-8d25-f5cc70a2ed52 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:43.087064 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3427cf31-4f7b-42e9-8d25-f5cc70a2ed52 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:43.088769 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3427cf31-4f7b-42e9-8d25-f5cc70a2ed52 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:43.090131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3427cf31-4f7b-42e9-8d25-f5cc70a2ed52 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1407 microversion: 2.20 time: 0.285854 Feb 17 03:35:43.090913 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 484/977] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:42 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:43.587700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-57e0673b-03bb-4e10-81c9-4b0b122adca7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:43.588455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-57e0673b-03bb-4e10-81c9-4b0b122adca7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:43.597315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-57e0673b-03bb-4e10-81c9-4b0b122adca7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:43.597825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-57e0673b-03bb-4e10-81c9-4b0b122adca7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:43.598679 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-57e0673b-03bb-4e10-81c9-4b0b122adca7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:43.599172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-57e0673b-03bb-4e10-81c9-4b0b122adca7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:43.821721 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-57e0673b-03bb-4e10-81c9-4b0b122adca7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:43.831760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-57e0673b-03bb-4e10-81c9-4b0b122adca7 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1583 microversion: 2.1 time: 0.247994 Feb 17 03:35:43.832429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 494/978] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:43 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1583 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:44.031007 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-35fd06fc-4c02-4e67-a6c0-f4bc9a33e34d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:44.031739 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-35fd06fc-4c02-4e67-a6c0-f4bc9a33e34d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:44.041019 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-35fd06fc-4c02-4e67-a6c0-f4bc9a33e34d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:44.041557 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-35fd06fc-4c02-4e67-a6c0-f4bc9a33e34d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:44.042418 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-35fd06fc-4c02-4e67-a6c0-f4bc9a33e34d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:44.042914 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-35fd06fc-4c02-4e67-a6c0-f4bc9a33e34d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:44.109578 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e2f6042a-6f6e-433a-9bb5-6c4c674f3f10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:44.110247 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e2f6042a-6f6e-433a-9bb5-6c4c674f3f10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:44.118810 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2f6042a-6f6e-433a-9bb5-6c4c674f3f10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:44.119314 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2f6042a-6f6e-433a-9bb5-6c4c674f3f10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:44.120162 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2f6042a-6f6e-433a-9bb5-6c4c674f3f10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:44.120652 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2f6042a-6f6e-433a-9bb5-6c4c674f3f10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:44.292216 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-35fd06fc-4c02-4e67-a6c0-f4bc9a33e34d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:44.302637 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-35fd06fc-4c02-4e67-a6c0-f4bc9a33e34d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1357 microversion: 2.1 time: 0.275595 Feb 17 03:35:44.303252 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 485/979] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:44 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1357 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:44.370470 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e2f6042a-6f6e-433a-9bb5-6c4c674f3f10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:44.381773 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e2f6042a-6f6e-433a-9bb5-6c4c674f3f10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:44.383954 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e2f6042a-6f6e-433a-9bb5-6c4c674f3f10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:44.384739 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e2f6042a-6f6e-433a-9bb5-6c4c674f3f10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1407 microversion: 2.20 time: 0.279295 Feb 17 03:35:44.385552 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 495/980] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:44 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:44.850874 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c8e9f6f7-b658-4182-92c4-07e00aaf96cb tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:44.851560 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c8e9f6f7-b658-4182-92c4-07e00aaf96cb tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:44.860654 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c8e9f6f7-b658-4182-92c4-07e00aaf96cb tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:44.861191 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c8e9f6f7-b658-4182-92c4-07e00aaf96cb tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:44.862612 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c8e9f6f7-b658-4182-92c4-07e00aaf96cb tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:44.863221 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c8e9f6f7-b658-4182-92c4-07e00aaf96cb tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:45.082105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c8e9f6f7-b658-4182-92c4-07e00aaf96cb tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:45.091325 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c8e9f6f7-b658-4182-92c4-07e00aaf96cb tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1583 microversion: 2.1 time: 0.244505 Feb 17 03:35:45.091947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 486/981] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:44 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1583 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:45.322211 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2e739a2d-9396-4624-890a-7a6c28208694 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:45.323173 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2e739a2d-9396-4624-890a-7a6c28208694 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:45.331790 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e739a2d-9396-4624-890a-7a6c28208694 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:45.332290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e739a2d-9396-4624-890a-7a6c28208694 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:45.333199 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e739a2d-9396-4624-890a-7a6c28208694 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:45.333804 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e739a2d-9396-4624-890a-7a6c28208694 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:45.404834 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1a477a7e-e3be-4579-b688-161ebebe0061 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:45.405885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1a477a7e-e3be-4579-b688-161ebebe0061 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:45.418466 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1a477a7e-e3be-4579-b688-161ebebe0061 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:45.419083 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1a477a7e-e3be-4579-b688-161ebebe0061 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:45.419986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1a477a7e-e3be-4579-b688-161ebebe0061 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:45.420714 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1a477a7e-e3be-4579-b688-161ebebe0061 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:45.578253 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2e739a2d-9396-4624-890a-7a6c28208694 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:45.587641 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2e739a2d-9396-4624-890a-7a6c28208694 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1357 microversion: 2.1 time: 0.269607 Feb 17 03:35:45.588372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 496/982] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:45 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1357 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:45.651807 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1a477a7e-e3be-4579-b688-161ebebe0061 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:45.663781 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1a477a7e-e3be-4579-b688-161ebebe0061 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:45.665421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1a477a7e-e3be-4579-b688-161ebebe0061 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:45.666665 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1a477a7e-e3be-4579-b688-161ebebe0061 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1407 microversion: 2.20 time: 0.266443 Feb 17 03:35:45.667432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 487/983] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:45 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:35:46.112083 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-99bc1973-0548-4c4d-9105-0c16074e6cae tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:46.113577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-99bc1973-0548-4c4d-9105-0c16074e6cae tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:46.121052 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-99bc1973-0548-4c4d-9105-0c16074e6cae tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:46.121582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-99bc1973-0548-4c4d-9105-0c16074e6cae tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:46.122714 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-99bc1973-0548-4c4d-9105-0c16074e6cae tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:46.123383 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-99bc1973-0548-4c4d-9105-0c16074e6cae tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:46.381994 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-99bc1973-0548-4c4d-9105-0c16074e6cae tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:46.391312 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-99bc1973-0548-4c4d-9105-0c16074e6cae tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1583 microversion: 2.1 time: 0.284402 Feb 17 03:35:46.391931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 497/984] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:46 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1583 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:35:46.607140 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-124343e4-c540-4c3d-8d24-d56a4e9268f5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:46.608322 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-124343e4-c540-4c3d-8d24-d56a4e9268f5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:46.623736 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-124343e4-c540-4c3d-8d24-d56a4e9268f5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:46.624253 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-124343e4-c540-4c3d-8d24-d56a4e9268f5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:46.625169 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-124343e4-c540-4c3d-8d24-d56a4e9268f5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:46.625663 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-124343e4-c540-4c3d-8d24-d56a4e9268f5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:46.689880 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b3eea109-5015-43f8-b06b-331032a73c6f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:46.691096 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b3eea109-5015-43f8-b06b-331032a73c6f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:46.704198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b3eea109-5015-43f8-b06b-331032a73c6f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:46.704871 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b3eea109-5015-43f8-b06b-331032a73c6f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:46.705925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b3eea109-5015-43f8-b06b-331032a73c6f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:46.706555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b3eea109-5015-43f8-b06b-331032a73c6f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:47.072214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b3eea109-5015-43f8-b06b-331032a73c6f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:47.083765 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b3eea109-5015-43f8-b06b-331032a73c6f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:47.085532 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b3eea109-5015-43f8-b06b-331032a73c6f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:47.086765 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b3eea109-5015-43f8-b06b-331032a73c6f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1407 microversion: 2.20 time: 0.404083 Feb 17 03:35:47.087702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 498/985] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:46 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:47.114038 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-124343e4-c540-4c3d-8d24-d56a4e9268f5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:47.124174 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-124343e4-c540-4c3d-8d24-d56a4e9268f5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1357 microversion: 2.1 time: 0.521082 Feb 17 03:35:47.124857 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 488/986] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:46 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1357 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:47.411919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e49e3732-7ade-4e49-a7bc-9efe2c5ef5ff tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:47.412585 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e49e3732-7ade-4e49-a7bc-9efe2c5ef5ff tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:47.420671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e49e3732-7ade-4e49-a7bc-9efe2c5ef5ff tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:47.421198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e49e3732-7ade-4e49-a7bc-9efe2c5ef5ff tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:47.422048 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e49e3732-7ade-4e49-a7bc-9efe2c5ef5ff tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:47.422539 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e49e3732-7ade-4e49-a7bc-9efe2c5ef5ff tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:47.702564 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e49e3732-7ade-4e49-a7bc-9efe2c5ef5ff tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:47.713508 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e49e3732-7ade-4e49-a7bc-9efe2c5ef5ff tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1583 microversion: 2.1 time: 0.305574 Feb 17 03:35:47.714882 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 499/987] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:47 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1583 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:48.112592 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7a56f9c2-f6ce-4946-bd0e-9298fffd1529 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:48.113889 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7a56f9c2-f6ce-4946-bd0e-9298fffd1529 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:48.130137 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7a56f9c2-f6ce-4946-bd0e-9298fffd1529 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:48.131045 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7a56f9c2-f6ce-4946-bd0e-9298fffd1529 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:48.132459 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7a56f9c2-f6ce-4946-bd0e-9298fffd1529 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:48.133323 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7a56f9c2-f6ce-4946-bd0e-9298fffd1529 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:48.143940 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c5fa90e4-c831-460b-ad72-8386e395e073 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:48.144632 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c5fa90e4-c831-460b-ad72-8386e395e073 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:48.158590 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c5fa90e4-c831-460b-ad72-8386e395e073 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:48.159402 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c5fa90e4-c831-460b-ad72-8386e395e073 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:48.160713 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c5fa90e4-c831-460b-ad72-8386e395e073 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:48.161539 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c5fa90e4-c831-460b-ad72-8386e395e073 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:48.444493 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7a56f9c2-f6ce-4946-bd0e-9298fffd1529 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:48.455189 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7a56f9c2-f6ce-4946-bd0e-9298fffd1529 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:48.456800 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7a56f9c2-f6ce-4946-bd0e-9298fffd1529 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:48.458047 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7a56f9c2-f6ce-4946-bd0e-9298fffd1529 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1407 microversion: 2.20 time: 0.354208 Feb 17 03:35:48.458655 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 489/988] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:48 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1407 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:48.488487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c5fa90e4-c831-460b-ad72-8386e395e073 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:48.506780 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c5fa90e4-c831-460b-ad72-8386e395e073 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1357 microversion: 2.1 time: 0.367970 Feb 17 03:35:48.507405 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 500/989] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:48 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1357 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:35:48.740570 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e735cb3d-6526-4f32-9d1e-4fcf873d662d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:48.741274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e735cb3d-6526-4f32-9d1e-4fcf873d662d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:48.749573 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e735cb3d-6526-4f32-9d1e-4fcf873d662d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:48.750085 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e735cb3d-6526-4f32-9d1e-4fcf873d662d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:48.750938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e735cb3d-6526-4f32-9d1e-4fcf873d662d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:48.751435 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e735cb3d-6526-4f32-9d1e-4fcf873d662d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:48.966113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e735cb3d-6526-4f32-9d1e-4fcf873d662d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:48.975984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e735cb3d-6526-4f32-9d1e-4fcf873d662d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1583 microversion: 2.1 time: 0.241574 Feb 17 03:35:48.976646 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 490/990] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:48 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1583 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:49.478685 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-60053ada-2b9d-4253-8490-09b381086b64 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:49.479408 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-60053ada-2b9d-4253-8490-09b381086b64 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:49.487773 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-60053ada-2b9d-4253-8490-09b381086b64 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:49.488271 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-60053ada-2b9d-4253-8490-09b381086b64 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:49.489147 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-60053ada-2b9d-4253-8490-09b381086b64 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:49.489631 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-60053ada-2b9d-4253-8490-09b381086b64 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:49.526221 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4fadb643-0b83-4ab0-bf46-99f5407833e7 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:49.527003 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4fadb643-0b83-4ab0-bf46-99f5407833e7 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:49.534977 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4fadb643-0b83-4ab0-bf46-99f5407833e7 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:49.535487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4fadb643-0b83-4ab0-bf46-99f5407833e7 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:49.536344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4fadb643-0b83-4ab0-bf46-99f5407833e7 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:49.536851 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4fadb643-0b83-4ab0-bf46-99f5407833e7 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:49.726404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-60053ada-2b9d-4253-8490-09b381086b64 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:49.737138 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-60053ada-2b9d-4253-8490-09b381086b64 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:49.738652 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-60053ada-2b9d-4253-8490-09b381086b64 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:49.740131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-60053ada-2b9d-4253-8490-09b381086b64 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1407 microversion: 2.20 time: 0.265554 Feb 17 03:35:49.741021 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 501/991] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:49 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:49.789014 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4fadb643-0b83-4ab0-bf46-99f5407833e7 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:49.799225 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4fadb643-0b83-4ab0-bf46-99f5407833e7 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1357 microversion: 2.1 time: 0.277338 Feb 17 03:35:49.799853 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 491/992] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:49 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1357 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:49.994787 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-da71e6d6-bc9f-436e-bc11-85b779118b04 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:49.995332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-da71e6d6-bc9f-436e-bc11-85b779118b04 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:50.003674 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da71e6d6-bc9f-436e-bc11-85b779118b04 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:50.004178 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da71e6d6-bc9f-436e-bc11-85b779118b04 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:50.005052 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da71e6d6-bc9f-436e-bc11-85b779118b04 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:50.005534 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da71e6d6-bc9f-436e-bc11-85b779118b04 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:50.267085 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-da71e6d6-bc9f-436e-bc11-85b779118b04 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:50.276588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-da71e6d6-bc9f-436e-bc11-85b779118b04 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1583 microversion: 2.1 time: 0.285892 Feb 17 03:35:50.277430 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 502/993] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:49 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1583 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:50.768000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5448704c-9a49-472c-bf47-0f9652623a80 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:50.770302 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5448704c-9a49-472c-bf47-0f9652623a80 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:50.780626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5448704c-9a49-472c-bf47-0f9652623a80 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:50.781401 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5448704c-9a49-472c-bf47-0f9652623a80 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:50.782743 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5448704c-9a49-472c-bf47-0f9652623a80 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:50.783326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5448704c-9a49-472c-bf47-0f9652623a80 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:50.819524 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-09a52820-5336-4410-afa1-bee6ce11f73b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:50.820506 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-09a52820-5336-4410-afa1-bee6ce11f73b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:50.832173 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09a52820-5336-4410-afa1-bee6ce11f73b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:50.832682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09a52820-5336-4410-afa1-bee6ce11f73b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:50.833580 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09a52820-5336-4410-afa1-bee6ce11f73b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:50.834073 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09a52820-5336-4410-afa1-bee6ce11f73b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:51.097888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-09a52820-5336-4410-afa1-bee6ce11f73b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:51.107323 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-09a52820-5336-4410-afa1-bee6ce11f73b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1357 microversion: 2.1 time: 0.292074 Feb 17 03:35:51.108499 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 503/994] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:50 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1357 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:35:51.296171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fce1e3c1-1053-410e-bb5b-40610685d784 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:51.296845 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fce1e3c1-1053-410e-bb5b-40610685d784 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:51.305995 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fce1e3c1-1053-410e-bb5b-40610685d784 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:51.307063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fce1e3c1-1053-410e-bb5b-40610685d784 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:51.307687 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fce1e3c1-1053-410e-bb5b-40610685d784 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:51.307970 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5448704c-9a49-472c-bf47-0f9652623a80 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:51.308100 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fce1e3c1-1053-410e-bb5b-40610685d784 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:51.326584 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5448704c-9a49-472c-bf47-0f9652623a80 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:51.328823 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5448704c-9a49-472c-bf47-0f9652623a80 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:51.331268 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5448704c-9a49-472c-bf47-0f9652623a80 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1407 microversion: 2.20 time: 0.572525 Feb 17 03:35:51.332018 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 492/995] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:50 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1407 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:51.614712 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-fce1e3c1-1053-410e-bb5b-40610685d784 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:51.628550 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fce1e3c1-1053-410e-bb5b-40610685d784 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1583 microversion: 2.1 time: 0.336661 Feb 17 03:35:51.629506 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 504/996] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:51 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1583 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:35:52.007938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-4b0167c0-5e07-44fe-a6f3-5bea87c40d8a req-da82a9f6-efab-46cb-a3ba-b5ae22f4de21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307fa9d3-f0a5-4c33-aa27-7271e36ec239", "tag": "88c76ccb-10fd-4edc-b372-9a3bad57e105"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:52.009899 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:35:52.009899 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:35:52.019674 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-4b0167c0-5e07-44fe-a6f3-5bea87c40d8a req-da82a9f6-efab-46cb-a3ba-b5ae22f4de21 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:52.020159 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-4b0167c0-5e07-44fe-a6f3-5bea87c40d8a req-da82a9f6-efab-46cb-a3ba-b5ae22f4de21 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:52.039688 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-4b0167c0-5e07-44fe-a6f3-5bea87c40d8a req-da82a9f6-efab-46cb-a3ba-b5ae22f4de21 service nova] Creating event network-changed:88c76ccb-10fd-4edc-b372-9a3bad57e105 for instance 307fa9d3-f0a5-4c33-aa27-7271e36ec239 on hv-cinder-75994 Feb 17 03:35:52.045759 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-4b0167c0-5e07-44fe-a6f3-5bea87c40d8a req-da82a9f6-efab-46cb-a3ba-b5ae22f4de21 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041308 Feb 17 03:35:52.046492 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 493/997] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:35:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:35:52.127112 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c499ea0d-a279-4d2b-8886-17c8ca4bde55 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:52.128043 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c499ea0d-a279-4d2b-8886-17c8ca4bde55 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:52.137451 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c499ea0d-a279-4d2b-8886-17c8ca4bde55 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:52.138129 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c499ea0d-a279-4d2b-8886-17c8ca4bde55 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:52.139244 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c499ea0d-a279-4d2b-8886-17c8ca4bde55 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:52.139926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c499ea0d-a279-4d2b-8886-17c8ca4bde55 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:52.356033 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2afa1791-3310-4591-8e1f-51df0501b584 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:52.358302 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2afa1791-3310-4591-8e1f-51df0501b584 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:52.373214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2afa1791-3310-4591-8e1f-51df0501b584 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:52.373730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2afa1791-3310-4591-8e1f-51df0501b584 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:52.374613 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2afa1791-3310-4591-8e1f-51df0501b584 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:52.375107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2afa1791-3310-4591-8e1f-51df0501b584 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:52.448503 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c499ea0d-a279-4d2b-8886-17c8ca4bde55 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:52.462312 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c499ea0d-a279-4d2b-8886-17c8ca4bde55 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1357 microversion: 2.1 time: 0.339442 Feb 17 03:35:52.463382 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 505/998] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:52 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1357 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:52.655509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-af3c5a83-710c-4d30-9dcb-9ec0c44de335 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:52.658675 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-af3c5a83-710c-4d30-9dcb-9ec0c44de335 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:52.672048 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-af3c5a83-710c-4d30-9dcb-9ec0c44de335 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:52.672716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-af3c5a83-710c-4d30-9dcb-9ec0c44de335 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:52.674101 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-af3c5a83-710c-4d30-9dcb-9ec0c44de335 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:52.674847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-af3c5a83-710c-4d30-9dcb-9ec0c44de335 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:52.957893 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2afa1791-3310-4591-8e1f-51df0501b584 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:52.975984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2afa1791-3310-4591-8e1f-51df0501b584 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:52.978703 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2afa1791-3310-4591-8e1f-51df0501b584 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:52.980544 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2afa1791-3310-4591-8e1f-51df0501b584 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1407 microversion: 2.20 time: 0.632302 Feb 17 03:35:52.981597 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 494/999] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:52 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1407 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:52.985277 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-af3c5a83-710c-4d30-9dcb-9ec0c44de335 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:53.000350 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-af3c5a83-710c-4d30-9dcb-9ec0c44de335 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1583 microversion: 2.1 time: 0.355370 Feb 17 03:35:53.008456 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 506/1000] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:52 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1583 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:35:53.485686 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-68d12b8c-17de-4b0f-a4d1-f2acdadcc608 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:53.486627 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-68d12b8c-17de-4b0f-a4d1-f2acdadcc608 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:53.499118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-68d12b8c-17de-4b0f-a4d1-f2acdadcc608 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:53.499899 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-68d12b8c-17de-4b0f-a4d1-f2acdadcc608 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:53.501142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-68d12b8c-17de-4b0f-a4d1-f2acdadcc608 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:53.501773 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-68d12b8c-17de-4b0f-a4d1-f2acdadcc608 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:54.018435 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0a7e3274-8c17-449e-b98e-8a0adc186e9c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:54.019135 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0a7e3274-8c17-449e-b98e-8a0adc186e9c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:54.038675 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a7e3274-8c17-449e-b98e-8a0adc186e9c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:54.040315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a7e3274-8c17-449e-b98e-8a0adc186e9c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:54.041214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a7e3274-8c17-449e-b98e-8a0adc186e9c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:54.041911 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a7e3274-8c17-449e-b98e-8a0adc186e9c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:54.276020 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0a7e3274-8c17-449e-b98e-8a0adc186e9c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:54.286031 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0a7e3274-8c17-449e-b98e-8a0adc186e9c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:54.287745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0a7e3274-8c17-449e-b98e-8a0adc186e9c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:54.289625 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0a7e3274-8c17-449e-b98e-8a0adc186e9c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1598 microversion: 2.20 time: 0.281627 Feb 17 03:35:54.290006 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 507/1001] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:35:54 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1598 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:35:54.306131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-26050b92-ef5d-43e2-8fde-c75af88474b8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:54.307217 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-26050b92-ef5d-43e2-8fde-c75af88474b8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:54.313558 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-68d12b8c-17de-4b0f-a4d1-f2acdadcc608 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:54.316183 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-26050b92-ef5d-43e2-8fde-c75af88474b8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:54.316764 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-26050b92-ef5d-43e2-8fde-c75af88474b8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:54.317717 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-26050b92-ef5d-43e2-8fde-c75af88474b8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:54.318200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-26050b92-ef5d-43e2-8fde-c75af88474b8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:54.324037 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-68d12b8c-17de-4b0f-a4d1-f2acdadcc608 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1357 microversion: 2.1 time: 0.843032 Feb 17 03:35:54.324998 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 495/1002] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:53 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1357 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:54.330917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-50c2a8ed-e2cb-4bd0-b1ba-acb312edb06f req-09d62bef-5543-4281-8b30-ee61edea9460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce920548-efb2-455b-a260-d9b321d73cd9", "name": "network-vif-unplugged", "status": "completed", "tag": "ce570470-08b9-4b72-be9b-4b61e88ce552"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:54.332931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:35:54.332931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:35:54.343149 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-50c2a8ed-e2cb-4bd0-b1ba-acb312edb06f req-09d62bef-5543-4281-8b30-ee61edea9460 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:54.343807 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-50c2a8ed-e2cb-4bd0-b1ba-acb312edb06f req-09d62bef-5543-4281-8b30-ee61edea9460 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:54.363881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-50c2a8ed-e2cb-4bd0-b1ba-acb312edb06f req-09d62bef-5543-4281-8b30-ee61edea9460 service nova] Creating event network-vif-unplugged:ce570470-08b9-4b72-be9b-4b61e88ce552 for instance ce920548-efb2-455b-a260-d9b321d73cd9 on hv-cinder-75994 Feb 17 03:35:54.371015 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-50c2a8ed-e2cb-4bd0-b1ba-acb312edb06f req-09d62bef-5543-4281-8b30-ee61edea9460 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044580 Feb 17 03:35:54.371870 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 496/1003] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:35:54 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:35:54.377863 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-565f5488-5231-41f8-a2ea-9b6eb8488d20 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:54.378839 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-565f5488-5231-41f8-a2ea-9b6eb8488d20 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:54.389563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-565f5488-5231-41f8-a2ea-9b6eb8488d20 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:54.390193 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-565f5488-5231-41f8-a2ea-9b6eb8488d20 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:54.391146 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-565f5488-5231-41f8-a2ea-9b6eb8488d20 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:54.391729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-565f5488-5231-41f8-a2ea-9b6eb8488d20 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:54.578095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-26050b92-ef5d-43e2-8fde-c75af88474b8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:54.588343 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-26050b92-ef5d-43e2-8fde-c75af88474b8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1583 microversion: 2.1 time: 0.297183 Feb 17 03:35:54.589178 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 508/1004] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:54 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1583 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:54.860306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-565f5488-5231-41f8-a2ea-9b6eb8488d20 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.487117 Feb 17 03:35:54.861686 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 497/1005] 10.222.0.57 () {60 vars in 1306 bytes} [Wed Feb 17 03:35:54 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/os-interface => generated 285 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:35:55.346655 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2e9e82f4-3f0c-4b92-bc77-6f70944d5e50 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:55.347332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2e9e82f4-3f0c-4b92-bc77-6f70944d5e50 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:55.357703 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e9e82f4-3f0c-4b92-bc77-6f70944d5e50 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:55.358422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e9e82f4-3f0c-4b92-bc77-6f70944d5e50 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:55.359074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e9e82f4-3f0c-4b92-bc77-6f70944d5e50 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:55.359552 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e9e82f4-3f0c-4b92-bc77-6f70944d5e50 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:55.615347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8a1b8787-6846-41df-baec-a89c8c249614 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:55.616148 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8a1b8787-6846-41df-baec-a89c8c249614 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:55.625073 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a1b8787-6846-41df-baec-a89c8c249614 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:55.625594 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a1b8787-6846-41df-baec-a89c8c249614 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:55.626514 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a1b8787-6846-41df-baec-a89c8c249614 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:55.627015 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8a1b8787-6846-41df-baec-a89c8c249614 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:55.880126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2e9e82f4-3f0c-4b92-bc77-6f70944d5e50 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:55.892289 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2e9e82f4-3f0c-4b92-bc77-6f70944d5e50 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1357 microversion: 2.1 time: 0.550033 Feb 17 03:35:55.894292 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 509/1006] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:55 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1357 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:56.427917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8a1b8787-6846-41df-baec-a89c8c249614 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:56.438455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8a1b8787-6846-41df-baec-a89c8c249614 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1583 microversion: 2.1 time: 0.827387 Feb 17 03:35:56.439095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 498/1007] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:55 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1583 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:56.916938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d59cb8a5-5c49-4fe2-a75c-b9ea4a514422 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:56.917646 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d59cb8a5-5c49-4fe2-a75c-b9ea4a514422 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:56.926218 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d59cb8a5-5c49-4fe2-a75c-b9ea4a514422 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:56.926735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d59cb8a5-5c49-4fe2-a75c-b9ea4a514422 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:56.927701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d59cb8a5-5c49-4fe2-a75c-b9ea4a514422 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:56.928070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d59cb8a5-5c49-4fe2-a75c-b9ea4a514422 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:57.000868 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a2ce6295-f401-45ac-a4a8-703763f7d94e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:57.002047 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a2ce6295-f401-45ac-a4a8-703763f7d94e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:57.010232 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a2ce6295-f401-45ac-a4a8-703763f7d94e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:57.011033 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a2ce6295-f401-45ac-a4a8-703763f7d94e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:57.012217 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a2ce6295-f401-45ac-a4a8-703763f7d94e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:57.012900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a2ce6295-f401-45ac-a4a8-703763f7d94e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:57.156557 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a2ce6295-f401-45ac-a4a8-703763f7d94e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 14 microversion: 2.20 time: 0.159301 Feb 17 03:35:57.157831 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 499/1008] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:35:56 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:57.220973 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d59cb8a5-5c49-4fe2-a75c-b9ea4a514422 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:57.242002 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d59cb8a5-5c49-4fe2-a75c-b9ea4a514422 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1357 microversion: 2.1 time: 0.324562 Feb 17 03:35:57.243029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 510/1009] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:56 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1357 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:57.269870 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-489ec08b-f3fb-4a50-996d-eb6d556ef758 req-bc297794-3ef2-4066-9e63-8fc61d66fa46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce920548-efb2-455b-a260-d9b321d73cd9", "name": "network-vif-deleted", "tag": "ce570470-08b9-4b72-be9b-4b61e88ce552"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:57.272358 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:35:57.272358 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:35:57.293653 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-489ec08b-f3fb-4a50-996d-eb6d556ef758 req-bc297794-3ef2-4066-9e63-8fc61d66fa46 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:57.294415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-489ec08b-f3fb-4a50-996d-eb6d556ef758 req-bc297794-3ef2-4066-9e63-8fc61d66fa46 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:57.323619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-489ec08b-f3fb-4a50-996d-eb6d556ef758 req-bc297794-3ef2-4066-9e63-8fc61d66fa46 service nova] Creating event network-vif-deleted:ce570470-08b9-4b72-be9b-4b61e88ce552 for instance ce920548-efb2-455b-a260-d9b321d73cd9 on hv-cinder-75994 Feb 17 03:35:57.329772 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-489ec08b-f3fb-4a50-996d-eb6d556ef758 req-bc297794-3ef2-4066-9e63-8fc61d66fa46 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064183 Feb 17 03:35:57.330562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 511/1010] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:35:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:35:57.428055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-7d295e7d-8966-4922-90a7-7a1749df0e6c req-df72ae13-b8ba-4834-b214-5219afda96c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb13b0aa-8bce-4878-943d-e3483a430b36", "tag": "3536cbed-2c8d-4d95-bbc0-f2840e848748"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:57.430376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:35:57.430376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:35:57.441696 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-7d295e7d-8966-4922-90a7-7a1749df0e6c req-df72ae13-b8ba-4834-b214-5219afda96c6 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:57.442599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-7d295e7d-8966-4922-90a7-7a1749df0e6c req-df72ae13-b8ba-4834-b214-5219afda96c6 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:57.459963 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-85d88a8f-ec56-4f3e-a2d9-67db70c7516d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:57.461283 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-85d88a8f-ec56-4f3e-a2d9-67db70c7516d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:57.464367 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-7d295e7d-8966-4922-90a7-7a1749df0e6c req-df72ae13-b8ba-4834-b214-5219afda96c6 service nova] Creating event network-changed:3536cbed-2c8d-4d95-bbc0-f2840e848748 for instance eb13b0aa-8bce-4878-943d-e3483a430b36 on hv-cinder-75994 Feb 17 03:35:57.469808 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-7d295e7d-8966-4922-90a7-7a1749df0e6c req-df72ae13-b8ba-4834-b214-5219afda96c6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.309966 Feb 17 03:35:57.471746 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85d88a8f-ec56-4f3e-a2d9-67db70c7516d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:57.472541 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85d88a8f-ec56-4f3e-a2d9-67db70c7516d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:57.473207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 500/1011] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:35:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:35:57.474197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85d88a8f-ec56-4f3e-a2d9-67db70c7516d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:57.474773 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85d88a8f-ec56-4f3e-a2d9-67db70c7516d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:57.788290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-85d88a8f-ec56-4f3e-a2d9-67db70c7516d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:57.799881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-85d88a8f-ec56-4f3e-a2d9-67db70c7516d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 200 len: 1224 microversion: 2.1 time: 0.345349 Feb 17 03:35:57.811263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 512/1012] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:57 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 1224 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:35:58.169315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-77f5d645-c34b-41a7-a53d-085623d0eb11 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:58.171351 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-77f5d645-c34b-41a7-a53d-085623d0eb11 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:58.180338 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-77f5d645-c34b-41a7-a53d-085623d0eb11 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:58.181204 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-77f5d645-c34b-41a7-a53d-085623d0eb11 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:58.182301 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-77f5d645-c34b-41a7-a53d-085623d0eb11 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:58.183005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-77f5d645-c34b-41a7-a53d-085623d0eb11 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:58.261700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-91f8fb31-da38-43be-9ce2-7fc045542809 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:58.262368 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-91f8fb31-da38-43be-9ce2-7fc045542809 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:58.270440 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-91f8fb31-da38-43be-9ce2-7fc045542809 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:58.270950 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-91f8fb31-da38-43be-9ce2-7fc045542809 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:58.271795 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-91f8fb31-da38-43be-9ce2-7fc045542809 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:58.272645 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-91f8fb31-da38-43be-9ce2-7fc045542809 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:58.315793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-77f5d645-c34b-41a7-a53d-085623d0eb11 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 14 microversion: 2.20 time: 0.150990 Feb 17 03:35:58.316508 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 501/1013] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:35:58 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:35:58.507547 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-91f8fb31-da38-43be-9ce2-7fc045542809 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:58.519564 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-91f8fb31-da38-43be-9ce2-7fc045542809 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1357 microversion: 2.1 time: 0.261518 Feb 17 03:35:58.520416 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 513/1014] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:58 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1357 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:35:58.819759 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-194da8ba-28f9-4d09-b613-ae124dc0e291 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:58.820535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-194da8ba-28f9-4d09-b613-ae124dc0e291 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:58.834830 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-194da8ba-28f9-4d09-b613-ae124dc0e291 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:58.835344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-194da8ba-28f9-4d09-b613-ae124dc0e291 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:58.836197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-194da8ba-28f9-4d09-b613-ae124dc0e291 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:58.836690 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-194da8ba-28f9-4d09-b613-ae124dc0e291 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:58.878067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-eee1c52e-ed14-4390-9b33-5001422e9816 req-eee8f86c-d7c3-434d-b688-2df068c9bdb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307fa9d3-f0a5-4c33-aa27-7271e36ec239", "name": "network-vif-plugged", "status": "completed", "tag": "88c76ccb-10fd-4edc-b372-9a3bad57e105"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:58.880263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:35:58.880263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:35:58.892591 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-eee1c52e-ed14-4390-9b33-5001422e9816 req-eee8f86c-d7c3-434d-b688-2df068c9bdb5 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:58.893251 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-eee1c52e-ed14-4390-9b33-5001422e9816 req-eee8f86c-d7c3-434d-b688-2df068c9bdb5 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:58.908512 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-194da8ba-28f9-4d09-b613-ae124dc0e291 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] HTTP exception thrown: Instance ce920548-efb2-455b-a260-d9b321d73cd9 could not be found. Feb 17 03:35:58.909206 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-194da8ba-28f9-4d09-b613-ae124dc0e291 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Returning 404 to user: Instance ce920548-efb2-455b-a260-d9b321d73cd9 could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:35:58.910302 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-194da8ba-28f9-4d09-b613-ae124dc0e291 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 404 len: 111 microversion: 2.1 time: 0.095689 Feb 17 03:35:58.911271 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 502/1015] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:58 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:35:58.917570 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-eee1c52e-ed14-4390-9b33-5001422e9816 req-eee8f86c-d7c3-434d-b688-2df068c9bdb5 service nova] Creating event network-vif-plugged:88c76ccb-10fd-4edc-b372-9a3bad57e105 for instance 307fa9d3-f0a5-4c33-aa27-7271e36ec239 on hv-cinder-75994 Feb 17 03:35:58.924972 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-eee1c52e-ed14-4390-9b33-5001422e9816 req-eee8f86c-d7c3-434d-b688-2df068c9bdb5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054008 Feb 17 03:35:58.926001 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 514/1016] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:35:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:35:59.047559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f409aacd-1dad-4c6e-99f3-12b4f3675435 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-157387089", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-461955903", "security_groups": [{"name": "tempest-TestVolumeBootPattern-107357108"}], "block_device_mapping_v2": [{"uuid": "0587f459-8d6d-4266-8f32-d415c955e649", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3cb0cdf3-e2d2-4fae-b226-b086c7cc05ee"}]}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:59.267999 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-f409aacd-1dad-4c6e-99f3-12b4f3675435 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] validate_networks() for [('3cb0cdf3-e2d2-4fae-b226-b086c7cc05ee', None, None, None)] {{(pid=98104) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:35:59.328590 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e522e090-e3dd-400f-8c9d-2bc08201b7dc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:35:59.329928 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e522e090-e3dd-400f-8c9d-2bc08201b7dc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:59.338177 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e522e090-e3dd-400f-8c9d-2bc08201b7dc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:59.338866 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e522e090-e3dd-400f-8c9d-2bc08201b7dc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:59.339997 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e522e090-e3dd-400f-8c9d-2bc08201b7dc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:59.340630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e522e090-e3dd-400f-8c9d-2bc08201b7dc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:59.467759 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e522e090-e3dd-400f-8c9d-2bc08201b7dc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 14 microversion: 2.20 time: 0.143375 Feb 17 03:35:59.468379 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 515/1017] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:35:59 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:35:59.539423 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-08af2ca0-9e9b-4cb3-91b9-151e171f5bf3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:35:59.540205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-08af2ca0-9e9b-4cb3-91b9-151e171f5bf3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:35:59.549513 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-08af2ca0-9e9b-4cb3-91b9-151e171f5bf3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:59.550030 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-08af2ca0-9e9b-4cb3-91b9-151e171f5bf3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:59.550886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-08af2ca0-9e9b-4cb3-91b9-151e171f5bf3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:59.551392 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-08af2ca0-9e9b-4cb3-91b9-151e171f5bf3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:59.764915 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-08af2ca0-9e9b-4cb3-91b9-151e171f5bf3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:35:59.774000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-08af2ca0-9e9b-4cb3-91b9-151e171f5bf3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1357 microversion: 2.1 time: 0.239168 Feb 17 03:35:59.774589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 516/1018] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:35:59 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:35:59.905843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-f409aacd-1dad-4c6e-99f3-12b4f3675435 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Flavor limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:35:59.906317 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-f409aacd-1dad-4c6e-99f3-12b4f3675435 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Image limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:35:59.906857 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-f409aacd-1dad-4c6e-99f3-12b4f3675435 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Flavor pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:35:59.907480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-f409aacd-1dad-4c6e-99f3-12b4f3675435 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Image pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:35:59.907780 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-f409aacd-1dad-4c6e-99f3-12b4f3675435 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:35:59.916569 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f409aacd-1dad-4c6e-99f3-12b4f3675435 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:59.917137 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f409aacd-1dad-4c6e-99f3-12b4f3675435 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:59.917977 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f409aacd-1dad-4c6e-99f3-12b4f3675435 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:35:59.918466 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f409aacd-1dad-4c6e-99f3-12b4f3675435 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:35:59.937101 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-f409aacd-1dad-4c6e-99f3-12b4f3675435 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Getting quotas for project 09f977ccc1e54aa6bfffd127c9a4be7d. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:35:59.941417 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-f409aacd-1dad-4c6e-99f3-12b4f3675435 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Getting quotas for user 1c16fada80664e0cb2bc0031171b6c04 and project 09f977ccc1e54aa6bfffd127c9a4be7d. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:36:00.047301 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f409aacd-1dad-4c6e-99f3-12b4f3675435 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Going to run 1 instances... {{(pid=98104) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:36:00.049716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f409aacd-1dad-4c6e-99f3-12b4f3675435 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0587f459-8d6d-4266-8f32-d415c955e649',volume_size=None,volume_type=None)] {{(pid=98104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:36:00.230313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f409aacd-1dad-4c6e-99f3-12b4f3675435 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 412 microversion: 2.1 time: 1.188576 Feb 17 03:36:00.231026 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 503/1019] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:35:59 2021] POST /compute/v2.1/servers => generated 412 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:36:00.241932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9d34807a-e565-4ec3-988f-c730ce2a6fb1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:00.242806 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9d34807a-e565-4ec3-988f-c730ce2a6fb1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:00.325689 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9d34807a-e565-4ec3-988f-c730ce2a6fb1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:00.335045 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9d34807a-e565-4ec3-988f-c730ce2a6fb1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1093 microversion: 2.1 time: 0.097185 Feb 17 03:36:00.335671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 517/1020] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:00 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1093 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:00.480460 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ef3a9dd7-b927-41b5-aa59-6b92d3abefea tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:00.481828 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ef3a9dd7-b927-41b5-aa59-6b92d3abefea tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:00.494578 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef3a9dd7-b927-41b5-aa59-6b92d3abefea tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:00.495084 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef3a9dd7-b927-41b5-aa59-6b92d3abefea tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:00.495953 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef3a9dd7-b927-41b5-aa59-6b92d3abefea tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:00.496420 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef3a9dd7-b927-41b5-aa59-6b92d3abefea tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:00.674352 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ef3a9dd7-b927-41b5-aa59-6b92d3abefea tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 14 microversion: 2.20 time: 0.198176 Feb 17 03:36:00.675390 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 504/1021] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:00 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 14 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:00.792105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-81bbed78-5219-46d0-b6b4-e98cd20dcebd tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:00.792712 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-81bbed78-5219-46d0-b6b4-e98cd20dcebd tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:00.801555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-81bbed78-5219-46d0-b6b4-e98cd20dcebd tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:00.802084 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-81bbed78-5219-46d0-b6b4-e98cd20dcebd tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:00.802906 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-81bbed78-5219-46d0-b6b4-e98cd20dcebd tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:00.803396 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-81bbed78-5219-46d0-b6b4-e98cd20dcebd tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:01.037969 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-81bbed78-5219-46d0-b6b4-e98cd20dcebd tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:01.048084 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-81bbed78-5219-46d0-b6b4-e98cd20dcebd tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1357 microversion: 2.1 time: 0.259895 Feb 17 03:36:01.056385 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 518/1022] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:00 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1357 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:01.354659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-739ecaec-37d5-4e87-bdda-b1228b669b1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:01.355345 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-739ecaec-37d5-4e87-bdda-b1228b669b1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:01.364633 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-739ecaec-37d5-4e87-bdda-b1228b669b1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:01.365174 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-739ecaec-37d5-4e87-bdda-b1228b669b1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:01.366029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-739ecaec-37d5-4e87-bdda-b1228b669b1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:01.366522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-739ecaec-37d5-4e87-bdda-b1228b669b1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:01.688311 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1dc474f3-b80b-47c2-aa82-29f9a5bcc79e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:01.689509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1dc474f3-b80b-47c2-aa82-29f9a5bcc79e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:01.698019 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1dc474f3-b80b-47c2-aa82-29f9a5bcc79e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:01.698617 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1dc474f3-b80b-47c2-aa82-29f9a5bcc79e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:01.699542 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1dc474f3-b80b-47c2-aa82-29f9a5bcc79e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:01.700100 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1dc474f3-b80b-47c2-aa82-29f9a5bcc79e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:01.815008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-739ecaec-37d5-4e87-bdda-b1228b669b1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:01.824437 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-739ecaec-37d5-4e87-bdda-b1228b669b1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1199 microversion: 2.1 time: 0.474313 Feb 17 03:36:01.825144 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 505/1023] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:01 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1199 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:01.829916 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1dc474f3-b80b-47c2-aa82-29f9a5bcc79e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 14 microversion: 2.20 time: 0.145535 Feb 17 03:36:01.830654 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 519/1024] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:01 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:36:02.067076 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6f6d45d1-3ecd-4d3e-80bd-0eeed567cd7e tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:02.067747 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6f6d45d1-3ecd-4d3e-80bd-0eeed567cd7e tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:02.075987 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6f6d45d1-3ecd-4d3e-80bd-0eeed567cd7e tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:02.077267 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6f6d45d1-3ecd-4d3e-80bd-0eeed567cd7e tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:02.078839 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6f6d45d1-3ecd-4d3e-80bd-0eeed567cd7e tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:02.079625 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6f6d45d1-3ecd-4d3e-80bd-0eeed567cd7e tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:02.514893 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6f6d45d1-3ecd-4d3e-80bd-0eeed567cd7e tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:02.524263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6f6d45d1-3ecd-4d3e-80bd-0eeed567cd7e tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1548 microversion: 2.1 time: 0.461205 Feb 17 03:36:02.524875 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 506/1025] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:02 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1548 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:02.542834 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-46b3d4a2-0d5c-42b9-b179-62cc68c8a343 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:02.543968 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-46b3d4a2-0d5c-42b9-b179-62cc68c8a343 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:02.553709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-46b3d4a2-0d5c-42b9-b179-62cc68c8a343 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:02.554222 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-46b3d4a2-0d5c-42b9-b179-62cc68c8a343 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:02.555076 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-46b3d4a2-0d5c-42b9-b179-62cc68c8a343 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:02.555573 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-46b3d4a2-0d5c-42b9-b179-62cc68c8a343 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:02.771992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-46b3d4a2-0d5c-42b9-b179-62cc68c8a343 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:02.781693 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-46b3d4a2-0d5c-42b9-b179-62cc68c8a343 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1548 microversion: 2.1 time: 0.243438 Feb 17 03:36:02.793173 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 520/1026] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:02 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1548 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:02.798996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2b800f5c-9221-4625-b331-6d1a82c16406 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:02.802594 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:36:02.802594 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:36:02.803664 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2b800f5c-9221-4625-b331-6d1a82c16406 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:02.804490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2b800f5c-9221-4625-b331-6d1a82c16406 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Searching by: {'deleted': False, 'project_id': '688dfe990479484ba91f5f3241f71c34'} {{(pid=98104) get_all /opt/stack/nova/nova/compute/api.py:2833}} Feb 17 03:36:02.810338 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2b800f5c-9221-4625-b331-6d1a82c16406 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:02.810843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2b800f5c-9221-4625-b331-6d1a82c16406 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:02.811714 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2b800f5c-9221-4625-b331-6d1a82c16406 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:02.812212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2b800f5c-9221-4625-b331-6d1a82c16406 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:02.841427 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f99594ef-a083-472e-a9ba-f5e8f3265031 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:02.843292 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f99594ef-a083-472e-a9ba-f5e8f3265031 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:02.868110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f99594ef-a083-472e-a9ba-f5e8f3265031 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:02.868877 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f99594ef-a083-472e-a9ba-f5e8f3265031 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:02.869924 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f99594ef-a083-472e-a9ba-f5e8f3265031 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:02.870595 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f99594ef-a083-472e-a9ba-f5e8f3265031 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:02.916426 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.multi_cell_list [None req-2b800f5c-9221-4625-b331-6d1a82c16406 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=98104) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Feb 17 03:36:02.998123 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f99594ef-a083-472e-a9ba-f5e8f3265031 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 14 microversion: 2.20 time: 0.160976 Feb 17 03:36:03.000925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 521/1027] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:02 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:36:03.007364 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-34c67276-1fa9-49c7-9134-5a2daea069d8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:03.008141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-34c67276-1fa9-49c7-9134-5a2daea069d8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:03.017372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34c67276-1fa9-49c7-9134-5a2daea069d8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:03.017672 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2b800f5c-9221-4625-b331-6d1a82c16406 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.223095 Feb 17 03:36:03.017919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34c67276-1fa9-49c7-9134-5a2daea069d8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:03.018774 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 507/1028] 10.222.0.57 () {58 vars in 1115 bytes} [Wed Feb 17 03:36:02 2021] GET /compute/v2.1/servers => generated 341 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:03.018887 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34c67276-1fa9-49c7-9134-5a2daea069d8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:03.019292 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34c67276-1fa9-49c7-9134-5a2daea069d8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:03.028951 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f6ef229d-249b-42fc-b3c7-c7a95c09d01d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:03.030246 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f6ef229d-249b-42fc-b3c7-c7a95c09d01d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:03.039266 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6ef229d-249b-42fc-b3c7-c7a95c09d01d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:03.039835 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6ef229d-249b-42fc-b3c7-c7a95c09d01d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:03.040695 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6ef229d-249b-42fc-b3c7-c7a95c09d01d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:03.041224 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6ef229d-249b-42fc-b3c7-c7a95c09d01d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:03.265686 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-34c67276-1fa9-49c7-9134-5a2daea069d8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:03.275489 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-34c67276-1fa9-49c7-9134-5a2daea069d8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1271 microversion: 2.1 time: 0.275213 Feb 17 03:36:03.277164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 522/1029] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:02 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1271 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:03.427507 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f6ef229d-249b-42fc-b3c7-c7a95c09d01d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:03.437050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f6ef229d-249b-42fc-b3c7-c7a95c09d01d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1548 microversion: 2.1 time: 0.411980 Feb 17 03:36:03.437650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 508/1030] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:03 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1548 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:36:04.011882 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1a6c45b2-fcee-421e-bfdb-fe19fab5fbb5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:04.012938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1a6c45b2-fcee-421e-bfdb-fe19fab5fbb5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:04.021623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1a6c45b2-fcee-421e-bfdb-fe19fab5fbb5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:04.022136 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1a6c45b2-fcee-421e-bfdb-fe19fab5fbb5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:04.023004 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1a6c45b2-fcee-421e-bfdb-fe19fab5fbb5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:04.023502 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1a6c45b2-fcee-421e-bfdb-fe19fab5fbb5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:04.162043 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1a6c45b2-fcee-421e-bfdb-fe19fab5fbb5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 14 microversion: 2.20 time: 0.153973 Feb 17 03:36:04.166071 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 523/1031] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:04 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:04.295539 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a4049a63-da68-4208-8eb8-488474926a34 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:04.296564 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a4049a63-da68-4208-8eb8-488474926a34 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:04.304937 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4049a63-da68-4208-8eb8-488474926a34 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:04.305442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4049a63-da68-4208-8eb8-488474926a34 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:04.306305 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4049a63-da68-4208-8eb8-488474926a34 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:04.306993 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4049a63-da68-4208-8eb8-488474926a34 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:04.776244 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-946b3ea0-9eef-48da-b3a3-fd01209f9dee req-71bc63ae-02ad-4bc4-895f-6e144ff0b170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a647e7-a66d-4254-9011-71ced47c3312", "tag": "1eaf9637-4a5d-4be5-9bed-fd22ccba8da3"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:04.777945 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:36:04.777945 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:36:04.784766 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a4049a63-da68-4208-8eb8-488474926a34 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:04.788452 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-946b3ea0-9eef-48da-b3a3-fd01209f9dee req-71bc63ae-02ad-4bc4-895f-6e144ff0b170 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:04.788989 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-946b3ea0-9eef-48da-b3a3-fd01209f9dee req-71bc63ae-02ad-4bc4-895f-6e144ff0b170 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:04.794262 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a4049a63-da68-4208-8eb8-488474926a34 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1271 microversion: 2.1 time: 0.503454 Feb 17 03:36:04.795285 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 509/1032] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:04 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1271 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:04.810377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-946b3ea0-9eef-48da-b3a3-fd01209f9dee req-71bc63ae-02ad-4bc4-895f-6e144ff0b170 service nova] Creating event network-changed:1eaf9637-4a5d-4be5-9bed-fd22ccba8da3 for instance 43a647e7-a66d-4254-9011-71ced47c3312 on hv-cinder-75994 Feb 17 03:36:04.815645 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-946b3ea0-9eef-48da-b3a3-fd01209f9dee req-71bc63ae-02ad-4bc4-895f-6e144ff0b170 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043902 Feb 17 03:36:04.816410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 524/1033] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:36:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:05.174725 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b3df621b-3138-44c3-a1c7-146aad0a42e8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:05.175971 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b3df621b-3138-44c3-a1c7-146aad0a42e8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:05.184014 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b3df621b-3138-44c3-a1c7-146aad0a42e8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:05.184511 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b3df621b-3138-44c3-a1c7-146aad0a42e8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:05.185989 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b3df621b-3138-44c3-a1c7-146aad0a42e8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:05.186481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b3df621b-3138-44c3-a1c7-146aad0a42e8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:05.312854 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b3df621b-3138-44c3-a1c7-146aad0a42e8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 14 microversion: 2.20 time: 0.142851 Feb 17 03:36:05.316795 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 510/1034] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:05 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:05.366445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a45d9683-e781-419f-b610-27caedb4b7c3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "447e9f53-5ba0-46ee-8d35-1d6c69dfb0a8"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:05.367879 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a45d9683-e781-419f-b610-27caedb4b7c3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:05.377335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a45d9683-e781-419f-b610-27caedb4b7c3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:05.377849 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a45d9683-e781-419f-b610-27caedb4b7c3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:05.378718 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a45d9683-e781-419f-b610-27caedb4b7c3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:05.379216 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a45d9683-e781-419f-b610-27caedb4b7c3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:05.795858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a45d9683-e781-419f-b610-27caedb4b7c3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "POST /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.433479 Feb 17 03:36:05.796528 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 525/1035] 10.222.0.57 () {60 vars in 1313 bytes} [Wed Feb 17 03:36:05 2021] POST /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/os-volume_attachments => generated 194 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:05.814067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-701e82cd-7b9f-4910-8389-1545ab801cbe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:05.814840 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-701e82cd-7b9f-4910-8389-1545ab801cbe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:05.824680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-701e82cd-7b9f-4910-8389-1545ab801cbe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:05.825502 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-701e82cd-7b9f-4910-8389-1545ab801cbe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:05.827160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-701e82cd-7b9f-4910-8389-1545ab801cbe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:05.827653 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-701e82cd-7b9f-4910-8389-1545ab801cbe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:06.280635 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-701e82cd-7b9f-4910-8389-1545ab801cbe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:06.290319 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-701e82cd-7b9f-4910-8389-1545ab801cbe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1271 microversion: 2.1 time: 0.482092 Feb 17 03:36:06.290911 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 511/1036] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:05 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1271 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:06.325962 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5b8bbc63-3f57-4269-8b71-bbeaaae61112 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:06.328377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5b8bbc63-3f57-4269-8b71-bbeaaae61112 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:06.337513 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5b8bbc63-3f57-4269-8b71-bbeaaae61112 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:06.338029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5b8bbc63-3f57-4269-8b71-bbeaaae61112 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:06.338885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5b8bbc63-3f57-4269-8b71-bbeaaae61112 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:06.339387 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5b8bbc63-3f57-4269-8b71-bbeaaae61112 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:06.516062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5b8bbc63-3f57-4269-8b71-bbeaaae61112 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 9123 microversion: 2.20 time: 0.194756 Feb 17 03:36:06.516908 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 526/1037] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:06 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 9123 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:36:07.308217 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4582b45c-9916-4938-a3f9-527e35397697 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:07.308805 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4582b45c-9916-4938-a3f9-527e35397697 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:07.317372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4582b45c-9916-4938-a3f9-527e35397697 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:07.317883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4582b45c-9916-4938-a3f9-527e35397697 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:07.318720 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4582b45c-9916-4938-a3f9-527e35397697 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:07.319215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4582b45c-9916-4938-a3f9-527e35397697 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:07.528557 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4582b45c-9916-4938-a3f9-527e35397697 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:07.530117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3c6a7bab-de8e-4d86-b665-91779d5e8efc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:07.531329 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3c6a7bab-de8e-4d86-b665-91779d5e8efc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:07.538140 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4582b45c-9916-4938-a3f9-527e35397697 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1271 microversion: 2.1 time: 0.233985 Feb 17 03:36:07.538741 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 512/1038] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:07 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1271 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:07.539993 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3c6a7bab-de8e-4d86-b665-91779d5e8efc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:07.540503 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3c6a7bab-de8e-4d86-b665-91779d5e8efc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:07.541500 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3c6a7bab-de8e-4d86-b665-91779d5e8efc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:07.541996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3c6a7bab-de8e-4d86-b665-91779d5e8efc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:07.678109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3c6a7bab-de8e-4d86-b665-91779d5e8efc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 16196 microversion: 2.20 time: 0.153242 Feb 17 03:36:07.678849 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 527/1039] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:07 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 16196 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:36:08.556304 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c3244adf-3581-4dd7-937a-174474c359b6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:08.556971 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c3244adf-3581-4dd7-937a-174474c359b6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:08.565553 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3244adf-3581-4dd7-937a-174474c359b6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:08.566063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3244adf-3581-4dd7-937a-174474c359b6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:08.566905 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3244adf-3581-4dd7-937a-174474c359b6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:08.567398 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3244adf-3581-4dd7-937a-174474c359b6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:08.691304 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0b1ead94-9034-4799-9e7e-beec9ef3144a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:08.692456 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0b1ead94-9034-4799-9e7e-beec9ef3144a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:08.701588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0b1ead94-9034-4799-9e7e-beec9ef3144a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:08.702095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0b1ead94-9034-4799-9e7e-beec9ef3144a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:08.702955 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0b1ead94-9034-4799-9e7e-beec9ef3144a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:08.703445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0b1ead94-9034-4799-9e7e-beec9ef3144a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:08.784445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c3244adf-3581-4dd7-937a-174474c359b6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:08.793456 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c3244adf-3581-4dd7-937a-174474c359b6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1271 microversion: 2.1 time: 0.241164 Feb 17 03:36:08.794106 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 513/1040] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:08 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1271 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:08.852696 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0b1ead94-9034-4799-9e7e-beec9ef3144a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 18561 microversion: 2.20 time: 0.165682 Feb 17 03:36:08.853498 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 528/1041] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:08 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 18561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:09.053864 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a1acc011-7f58-4970-886c-10e1e0f97abc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:09.054410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a1acc011-7f58-4970-886c-10e1e0f97abc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:09.062378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1acc011-7f58-4970-886c-10e1e0f97abc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:09.062886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1acc011-7f58-4970-886c-10e1e0f97abc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:09.063718 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1acc011-7f58-4970-886c-10e1e0f97abc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:09.064208 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1acc011-7f58-4970-886c-10e1e0f97abc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:09.132959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a1acc011-7f58-4970-886c-10e1e0f97abc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Going to try to terminate instance {{(pid=98104) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:36:09.278367 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a1acc011-7f58-4970-886c-10e1e0f97abc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 204 len: 0 microversion: 2.1 time: 0.227602 Feb 17 03:36:09.280335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 514/1042] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:36:09 2021] DELETE /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:36:09.292136 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-90817958-05fd-47e3-a0e7-36c26e075fb0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:09.293228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-90817958-05fd-47e3-a0e7-36c26e075fb0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:09.303896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90817958-05fd-47e3-a0e7-36c26e075fb0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:09.304409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90817958-05fd-47e3-a0e7-36c26e075fb0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:09.305330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90817958-05fd-47e3-a0e7-36c26e075fb0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:09.305823 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-90817958-05fd-47e3-a0e7-36c26e075fb0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:09.532202 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-90817958-05fd-47e3-a0e7-36c26e075fb0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:09.541865 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-90817958-05fd-47e3-a0e7-36c26e075fb0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1674 microversion: 2.1 time: 0.254468 Feb 17 03:36:09.542481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 529/1043] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:09 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1674 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:36:09.813678 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f405c33e-13ba-4f19-b3b9-a6f4ee451c72 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:09.814413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f405c33e-13ba-4f19-b3b9-a6f4ee451c72 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:09.823254 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f405c33e-13ba-4f19-b3b9-a6f4ee451c72 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:09.823758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f405c33e-13ba-4f19-b3b9-a6f4ee451c72 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:09.824604 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f405c33e-13ba-4f19-b3b9-a6f4ee451c72 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:09.825130 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f405c33e-13ba-4f19-b3b9-a6f4ee451c72 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:09.865475 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3f6a0b4b-aa39-49ce-b744-0f14f0c45631 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:09.866526 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3f6a0b4b-aa39-49ce-b744-0f14f0c45631 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:09.875319 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3f6a0b4b-aa39-49ce-b744-0f14f0c45631 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:09.875800 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3f6a0b4b-aa39-49ce-b744-0f14f0c45631 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:09.877267 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3f6a0b4b-aa39-49ce-b744-0f14f0c45631 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:09.877782 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3f6a0b4b-aa39-49ce-b744-0f14f0c45631 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:10.013181 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3f6a0b4b-aa39-49ce-b744-0f14f0c45631 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 20271 microversion: 2.20 time: 0.151539 Feb 17 03:36:10.014806 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 530/1044] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:09 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 20271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:10.041867 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f405c33e-13ba-4f19-b3b9-a6f4ee451c72 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:10.051337 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f405c33e-13ba-4f19-b3b9-a6f4ee451c72 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1271 microversion: 2.1 time: 0.242936 Feb 17 03:36:10.051939 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 515/1045] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:09 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:10.561417 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2e53b019-bb08-40c4-a81d-7a7fc4eba4ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:10.562087 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2e53b019-bb08-40c4-a81d-7a7fc4eba4ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:10.570786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e53b019-bb08-40c4-a81d-7a7fc4eba4ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:10.571547 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e53b019-bb08-40c4-a81d-7a7fc4eba4ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:10.572394 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e53b019-bb08-40c4-a81d-7a7fc4eba4ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:10.572886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e53b019-bb08-40c4-a81d-7a7fc4eba4ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:10.797272 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2e53b019-bb08-40c4-a81d-7a7fc4eba4ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:10.810045 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2e53b019-bb08-40c4-a81d-7a7fc4eba4ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1674 microversion: 2.1 time: 0.253159 Feb 17 03:36:10.810671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 531/1046] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:10 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1674 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:11.026131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ee5e26a4-45b0-4f5b-921a-ad2fe1c75055 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:11.027229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ee5e26a4-45b0-4f5b-921a-ad2fe1c75055 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:11.035789 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee5e26a4-45b0-4f5b-921a-ad2fe1c75055 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:11.036290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee5e26a4-45b0-4f5b-921a-ad2fe1c75055 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:11.037168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee5e26a4-45b0-4f5b-921a-ad2fe1c75055 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:11.037659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee5e26a4-45b0-4f5b-921a-ad2fe1c75055 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:11.070055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cafd98f8-4c95-49a5-b20c-e1530f75d954 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:11.071232 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cafd98f8-4c95-49a5-b20c-e1530f75d954 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:11.080348 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cafd98f8-4c95-49a5-b20c-e1530f75d954 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:11.080971 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cafd98f8-4c95-49a5-b20c-e1530f75d954 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:11.081860 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cafd98f8-4c95-49a5-b20c-e1530f75d954 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:11.082351 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cafd98f8-4c95-49a5-b20c-e1530f75d954 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:11.172315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ee5e26a4-45b0-4f5b-921a-ad2fe1c75055 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 22715 microversion: 2.20 time: 0.150404 Feb 17 03:36:11.173370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 516/1047] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:11 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 22715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:11.307307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-cafd98f8-4c95-49a5-b20c-e1530f75d954 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:11.317488 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cafd98f8-4c95-49a5-b20c-e1530f75d954 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1271 microversion: 2.1 time: 0.251447 Feb 17 03:36:11.318367 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 532/1048] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:11 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:36:11.829411 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2858702d-e063-4722-ae2f-f74878123284 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:11.830200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2858702d-e063-4722-ae2f-f74878123284 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:11.839413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2858702d-e063-4722-ae2f-f74878123284 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:11.839923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2858702d-e063-4722-ae2f-f74878123284 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:11.840790 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2858702d-e063-4722-ae2f-f74878123284 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:11.841315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2858702d-e063-4722-ae2f-f74878123284 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:12.185908 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-302754b5-7d7e-437f-a410-cba2e4227800 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:12.187074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-302754b5-7d7e-437f-a410-cba2e4227800 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:12.197065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-302754b5-7d7e-437f-a410-cba2e4227800 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:12.197573 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-302754b5-7d7e-437f-a410-cba2e4227800 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:12.198459 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-302754b5-7d7e-437f-a410-cba2e4227800 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:12.198960 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-302754b5-7d7e-437f-a410-cba2e4227800 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:12.263128 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2858702d-e063-4722-ae2f-f74878123284 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:12.278154 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2858702d-e063-4722-ae2f-f74878123284 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1607 microversion: 2.1 time: 0.453533 Feb 17 03:36:12.280192 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 517/1049] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:11 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1607 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:12.336154 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c65dc6ed-8a11-4904-a51c-c7451fdb0d3e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:12.337129 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c65dc6ed-8a11-4904-a51c-c7451fdb0d3e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:12.346415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c65dc6ed-8a11-4904-a51c-c7451fdb0d3e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:12.346932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c65dc6ed-8a11-4904-a51c-c7451fdb0d3e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:12.347800 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c65dc6ed-8a11-4904-a51c-c7451fdb0d3e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:12.348301 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c65dc6ed-8a11-4904-a51c-c7451fdb0d3e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:12.409917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-302754b5-7d7e-437f-a410-cba2e4227800 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 23865 microversion: 2.20 time: 0.228437 Feb 17 03:36:12.411202 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 533/1050] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:12 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 23865 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:36:12.682495 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-16716be5-f90e-40f2-9b29-3234807b2dc0 req-5af29dee-ce87-4300-912b-3db57553d20c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c5a8ede-8248-460e-bef7-6b5c3aaf48f5", "name": "network-vif-deleted", "tag": "48fb65e6-ad21-424b-ad45-8e4c51055da6"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:12.684518 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:36:12.684518 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:36:12.695081 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-16716be5-f90e-40f2-9b29-3234807b2dc0 req-5af29dee-ce87-4300-912b-3db57553d20c service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:12.695729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-16716be5-f90e-40f2-9b29-3234807b2dc0 req-5af29dee-ce87-4300-912b-3db57553d20c service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:12.715614 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c65dc6ed-8a11-4904-a51c-c7451fdb0d3e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:12.716915 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-16716be5-f90e-40f2-9b29-3234807b2dc0 req-5af29dee-ce87-4300-912b-3db57553d20c service nova] Creating event network-vif-deleted:48fb65e6-ad21-424b-ad45-8e4c51055da6 for instance 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 on hv-cinder-75994 Feb 17 03:36:12.721996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-16716be5-f90e-40f2-9b29-3234807b2dc0 req-5af29dee-ce87-4300-912b-3db57553d20c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044001 Feb 17 03:36:12.722645 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 534/1051] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:36:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:12.727590 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c65dc6ed-8a11-4904-a51c-c7451fdb0d3e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1271 microversion: 2.1 time: 0.395487 Feb 17 03:36:12.728413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 518/1052] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:12 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1271 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:13.298994 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-08b2d363-ee89-498a-9f2d-e3ea82848ac6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:13.300550 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-08b2d363-ee89-498a-9f2d-e3ea82848ac6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:13.308834 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-08b2d363-ee89-498a-9f2d-e3ea82848ac6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:13.309402 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-08b2d363-ee89-498a-9f2d-e3ea82848ac6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:13.310459 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-08b2d363-ee89-498a-9f2d-e3ea82848ac6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:13.310956 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-08b2d363-ee89-498a-9f2d-e3ea82848ac6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:13.386590 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-08b2d363-ee89-498a-9f2d-e3ea82848ac6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:13.387103 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-08b2d363-ee89-498a-9f2d-e3ea82848ac6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:13.387618 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-08b2d363-ee89-498a-9f2d-e3ea82848ac6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lazy-loading 'fault' on Instance uuid 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:36:13.425429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-faad818a-621e-4309-a46a-6b826609b050 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:13.426568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-faad818a-621e-4309-a46a-6b826609b050 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:13.443009 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-faad818a-621e-4309-a46a-6b826609b050 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:13.443502 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-faad818a-621e-4309-a46a-6b826609b050 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:13.445634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-faad818a-621e-4309-a46a-6b826609b050 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:13.446413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-faad818a-621e-4309-a46a-6b826609b050 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:13.479228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-08b2d363-ee89-498a-9f2d-e3ea82848ac6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:13.487752 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-08b2d363-ee89-498a-9f2d-e3ea82848ac6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 200 len: 1328 microversion: 2.1 time: 0.193954 Feb 17 03:36:13.488363 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 535/1053] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:13 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 1328 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:13.601206 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-faad818a-621e-4309-a46a-6b826609b050 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 25346 microversion: 2.20 time: 0.181510 Feb 17 03:36:13.602600 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 519/1054] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:13 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 25346 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:36:13.746771 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f8e9c256-0c23-43e0-8db2-2b08d0f7c9f9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:13.747667 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f8e9c256-0c23-43e0-8db2-2b08d0f7c9f9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:13.757243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8e9c256-0c23-43e0-8db2-2b08d0f7c9f9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:13.757888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8e9c256-0c23-43e0-8db2-2b08d0f7c9f9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:13.758788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8e9c256-0c23-43e0-8db2-2b08d0f7c9f9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:13.759467 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8e9c256-0c23-43e0-8db2-2b08d0f7c9f9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:13.907278 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a19fba0b-33c0-4537-b6ed-289e1b6292d9 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:13.908332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a19fba0b-33c0-4537-b6ed-289e1b6292d9 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:13.917390 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a19fba0b-33c0-4537-b6ed-289e1b6292d9 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:13.918167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a19fba0b-33c0-4537-b6ed-289e1b6292d9 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:13.919186 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a19fba0b-33c0-4537-b6ed-289e1b6292d9 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:13.919876 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a19fba0b-33c0-4537-b6ed-289e1b6292d9 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:14.012018 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f8e9c256-0c23-43e0-8db2-2b08d0f7c9f9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:14.022028 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f8e9c256-0c23-43e0-8db2-2b08d0f7c9f9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1271 microversion: 2.1 time: 0.279444 Feb 17 03:36:14.022999 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 536/1055] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:13 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1271 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:14.145386 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a19fba0b-33c0-4537-b6ed-289e1b6292d9 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:14.155151 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a19fba0b-33c0-4537-b6ed-289e1b6292d9 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1594 microversion: 2.1 time: 0.252294 Feb 17 03:36:14.155764 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 520/1056] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:13 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1594 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:14.173612 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-95d4f7cc-6a73-4a18-9b1a-a054b5b525a6 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Action: 'create', calling method: .version_select at 0x7f98b0407d08>, body: {"pool": null} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:14.506617 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b019fe93-49bb-4d67-8861-55160842f295 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:14.507182 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b019fe93-49bb-4d67-8861-55160842f295 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:14.515575 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b019fe93-49bb-4d67-8861-55160842f295 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:14.516065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b019fe93-49bb-4d67-8861-55160842f295 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:14.517198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b019fe93-49bb-4d67-8861-55160842f295 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:14.517675 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b019fe93-49bb-4d67-8861-55160842f295 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:14.574117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-b019fe93-49bb-4d67-8861-55160842f295 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] HTTP exception thrown: Instance 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 could not be found. Feb 17 03:36:14.574789 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b019fe93-49bb-4d67-8861-55160842f295 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Returning 404 to user: Instance 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:36:14.575701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b019fe93-49bb-4d67-8861-55160842f295 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 404 len: 111 microversion: 2.1 time: 0.073308 Feb 17 03:36:14.576439 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 521/1057] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:14 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:36:14.585146 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5ee9166d-f129-4d00-b10a-196ae7eca695 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '.version_select at 0x7f98b02da158>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:14.603194 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5ee9166d-f129-4d00-b10a-196ae7eca695 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1174879166" status: 202 len: 0 microversion: 2.1 time: 0.021769 Feb 17 03:36:14.604064 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 522/1058] 10.222.0.57 () {58 vars in 1211 bytes} [Wed Feb 17 03:36:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1174879166 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:36:14.615938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-af226f36-6593-46ac-865a-cad9779f44c3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:14.617954 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-af226f36-6593-46ac-865a-cad9779f44c3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:14.627123 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-af226f36-6593-46ac-865a-cad9779f44c3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:14.627640 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-af226f36-6593-46ac-865a-cad9779f44c3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:14.628508 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-af226f36-6593-46ac-865a-cad9779f44c3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:14.629523 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-af226f36-6593-46ac-865a-cad9779f44c3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:14.777678 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-af226f36-6593-46ac-865a-cad9779f44c3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 26748 microversion: 2.20 time: 0.166175 Feb 17 03:36:14.778659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 523/1059] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:14 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 26748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:36:15.040940 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bfec8f7f-598d-439b-88d8-ae375d1c8603 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:15.042282 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bfec8f7f-598d-439b-88d8-ae375d1c8603 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:15.053342 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bfec8f7f-598d-439b-88d8-ae375d1c8603 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:15.054317 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bfec8f7f-598d-439b-88d8-ae375d1c8603 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:15.055965 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bfec8f7f-598d-439b-88d8-ae375d1c8603 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:15.057016 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bfec8f7f-598d-439b-88d8-ae375d1c8603 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:15.574486 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bfec8f7f-598d-439b-88d8-ae375d1c8603 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:15.585145 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bfec8f7f-598d-439b-88d8-ae375d1c8603 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1271 microversion: 2.1 time: 0.548740 Feb 17 03:36:15.585744 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 524/1060] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:15 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1271 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:36:15.791351 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4b8a4559-9fb5-4b9f-9edb-323f5ade1154 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:15.792395 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4b8a4559-9fb5-4b9f-9edb-323f5ade1154 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:15.801282 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4b8a4559-9fb5-4b9f-9edb-323f5ade1154 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:15.802039 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4b8a4559-9fb5-4b9f-9edb-323f5ade1154 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:15.802895 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4b8a4559-9fb5-4b9f-9edb-323f5ade1154 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:15.803365 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4b8a4559-9fb5-4b9f-9edb-323f5ade1154 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:15.959692 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4b8a4559-9fb5-4b9f-9edb-323f5ade1154 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 27439 microversion: 2.20 time: 0.172450 Feb 17 03:36:15.960811 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 525/1061] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:15 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 27439 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:36:16.030353 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-22dea7e2-df3f-4872-8a55-9efc659aede5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'create', calling method: .version_select at 0x7f98b03dcbf8>, body: {"keypair": {"name": "tempest-keypair-102674015"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:16.054595 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-22dea7e2-df3f-4872-8a55-9efc659aede5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Getting quotas for project c568344bec0146c19c14571bff20a759. Resources: {'key_pairs'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:36:16.058716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-22dea7e2-df3f-4872-8a55-9efc659aede5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Getting quotas for user f60e8201ff554fefa20487ac8f981d07 and project c568344bec0146c19c14571bff20a759. Resources: {'key_pairs'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:36:16.226412 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-22dea7e2-df3f-4872-8a55-9efc659aede5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Getting quotas for project c568344bec0146c19c14571bff20a759. Resources: {'key_pairs'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:36:16.230671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-22dea7e2-df3f-4872-8a55-9efc659aede5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Getting quotas for user f60e8201ff554fefa20487ac8f981d07 and project c568344bec0146c19c14571bff20a759. Resources: {'key_pairs'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:36:16.247374 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-22dea7e2-df3f-4872-8a55-9efc659aede5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.221477 Feb 17 03:36:16.248134 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 526/1062] 10.222.0.57 () {60 vars in 1148 bytes} [Wed Feb 17 03:36:16 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:16.603537 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f25843cd-1868-423a-8181-886ffa98a8c2 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:16.604342 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f25843cd-1868-423a-8181-886ffa98a8c2 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:16.613756 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f25843cd-1868-423a-8181-886ffa98a8c2 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:16.614275 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f25843cd-1868-423a-8181-886ffa98a8c2 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:16.615145 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f25843cd-1868-423a-8181-886ffa98a8c2 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:16.615625 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f25843cd-1868-423a-8181-886ffa98a8c2 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:16.655963 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-95d4f7cc-6a73-4a18-9b1a-a054b5b525a6 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.486726 Feb 17 03:36:16.663805 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 537/1063] 10.222.0.57 () {60 vars in 1160 bytes} [Wed Feb 17 03:36:14 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:16.671008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-94773cc0-9aee-4796-ac33-22c401e0bc28 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Action: 'action', calling method: .version_select at 0x7f98b11edae8>, body: {"addFloatingIp": {"address": "172.27.0.175"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:16.674058 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-94773cc0-9aee-4796-ac33-22c401e0bc28 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:16.686776 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-94773cc0-9aee-4796-ac33-22c401e0bc28 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:16.687684 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-94773cc0-9aee-4796-ac33-22c401e0bc28 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:16.689188 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-94773cc0-9aee-4796-ac33-22c401e0bc28 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:16.690071 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-94773cc0-9aee-4796-ac33-22c401e0bc28 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:16.783805 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-94773cc0-9aee-4796-ac33-22c401e0bc28 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Acquired lock "refresh_cache-307fa9d3-f0a5-4c33-aa27-7271e36ec239" {{(pid=98103) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:36:16.869007 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f25843cd-1868-423a-8181-886ffa98a8c2 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:16.881006 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f25843cd-1868-423a-8181-886ffa98a8c2 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1271 microversion: 2.1 time: 0.281486 Feb 17 03:36:16.882136 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 527/1064] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:16 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1271 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:16.889251 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-6c76a26f-fb2e-4b5f-8c71-9f7c83095f79 req-a6ef0e0a-6de3-41af-9586-fec6eccd5d18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a647e7-a66d-4254-9011-71ced47c3312", "name": "network-vif-plugged", "status": "completed", "tag": "1eaf9637-4a5d-4be5-9bed-fd22ccba8da3"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:16.891525 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:36:16.891525 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:36:16.901176 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-6c76a26f-fb2e-4b5f-8c71-9f7c83095f79 req-a6ef0e0a-6de3-41af-9586-fec6eccd5d18 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:16.901900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-6c76a26f-fb2e-4b5f-8c71-9f7c83095f79 req-a6ef0e0a-6de3-41af-9586-fec6eccd5d18 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:16.923786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-6c76a26f-fb2e-4b5f-8c71-9f7c83095f79 req-a6ef0e0a-6de3-41af-9586-fec6eccd5d18 service nova] Creating event network-vif-plugged:1eaf9637-4a5d-4be5-9bed-fd22ccba8da3 for instance 43a647e7-a66d-4254-9011-71ced47c3312 on hv-cinder-75994 Feb 17 03:36:16.929228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-6c76a26f-fb2e-4b5f-8c71-9f7c83095f79 req-a6ef0e0a-6de3-41af-9586-fec6eccd5d18 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044983 Feb 17 03:36:16.929998 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 528/1065] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:36:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:16.973581 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1bcbb732-2ef9-4769-a177-a8be32ffe948 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:16.975501 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1bcbb732-2ef9-4769-a177-a8be32ffe948 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:16.984276 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1bcbb732-2ef9-4769-a177-a8be32ffe948 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:16.984935 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1bcbb732-2ef9-4769-a177-a8be32ffe948 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:16.986044 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1bcbb732-2ef9-4769-a177-a8be32ffe948 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:16.986565 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1bcbb732-2ef9-4769-a177-a8be32ffe948 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:17.128083 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1bcbb732-2ef9-4769-a177-a8be32ffe948 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 27746 microversion: 2.20 time: 0.159030 Feb 17 03:36:17.129462 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 529/1066] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:16 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 27746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:36:17.900764 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2fa02f78-302c-434f-8bf0-a0d114c4ac5f tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:17.902159 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2fa02f78-302c-434f-8bf0-a0d114c4ac5f tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:17.911964 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2fa02f78-302c-434f-8bf0-a0d114c4ac5f tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:17.912794 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2fa02f78-302c-434f-8bf0-a0d114c4ac5f tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:17.913854 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2fa02f78-302c-434f-8bf0-a0d114c4ac5f tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:17.914531 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2fa02f78-302c-434f-8bf0-a0d114c4ac5f tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:18.320459 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2fa02f78-302c-434f-8bf0-a0d114c4ac5f tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:18.331696 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2fa02f78-302c-434f-8bf0-a0d114c4ac5f tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1271 microversion: 2.1 time: 0.434875 Feb 17 03:36:18.342728 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 530/1067] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:17 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1271 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:36:18.342728 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e822668c-5aa1-4f13-b2a5-7fc8f0f041f0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:18.342728 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e822668c-5aa1-4f13-b2a5-7fc8f0f041f0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:18.350614 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e822668c-5aa1-4f13-b2a5-7fc8f0f041f0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:18.351116 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e822668c-5aa1-4f13-b2a5-7fc8f0f041f0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:18.351976 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e822668c-5aa1-4f13-b2a5-7fc8f0f041f0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:18.352465 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e822668c-5aa1-4f13-b2a5-7fc8f0f041f0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:18.499733 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e822668c-5aa1-4f13-b2a5-7fc8f0f041f0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28058 microversion: 2.20 time: 0.165061 Feb 17 03:36:18.504248 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 531/1068] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:18 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28058 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:19.189074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-94773cc0-9aee-4796-ac33-22c401e0bc28 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 03:36:19.199725 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-c7996de0-65ae-4b9d-b127-d852c1045274 req-9cd7dcf5-aa5f-46b1-96db-343e7f752a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307fa9d3-f0a5-4c33-aa27-7271e36ec239", "tag": "88c76ccb-10fd-4edc-b372-9a3bad57e105"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:19.201952 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:36:19.201952 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:36:19.213348 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-c7996de0-65ae-4b9d-b127-d852c1045274 req-9cd7dcf5-aa5f-46b1-96db-343e7f752a11 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:19.213843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-c7996de0-65ae-4b9d-b127-d852c1045274 req-9cd7dcf5-aa5f-46b1-96db-343e7f752a11 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:19.232042 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-c7996de0-65ae-4b9d-b127-d852c1045274 req-9cd7dcf5-aa5f-46b1-96db-343e7f752a11 service nova] Creating event network-changed:88c76ccb-10fd-4edc-b372-9a3bad57e105 for instance 307fa9d3-f0a5-4c33-aa27-7271e36ec239 on hv-cinder-75994 Feb 17 03:36:19.237785 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-c7996de0-65ae-4b9d-b127-d852c1045274 req-9cd7dcf5-aa5f-46b1-96db-343e7f752a11 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042440 Feb 17 03:36:19.238568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 532/1069] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:36:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:36:19.352454 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2ea9663d-4544-44fd-86ef-9b7508790417 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:19.353388 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2ea9663d-4544-44fd-86ef-9b7508790417 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:19.367685 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ea9663d-4544-44fd-86ef-9b7508790417 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:19.368433 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ea9663d-4544-44fd-86ef-9b7508790417 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:19.369309 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ea9663d-4544-44fd-86ef-9b7508790417 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:19.369873 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ea9663d-4544-44fd-86ef-9b7508790417 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:20.134331 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-94773cc0-9aee-4796-ac33-22c401e0bc28 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Updating instance_info_cache with network_info: [{"id": "88c76ccb-10fd-4edc-b372-9a3bad57e105", "address": "fa:16:3e:6d:43:11", "network": {"id": "b3188410-3b2d-4523-8ccc-1882d94255cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1775846261-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "688dfe990479484ba91f5f3241f71c34", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap88c76ccb-10", "ovs_interfaceid": "88c76ccb-10fd-4edc-b372-9a3bad57e105", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 03:36:20.137710 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2ea9663d-4544-44fd-86ef-9b7508790417 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:20.149206 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2ea9663d-4544-44fd-86ef-9b7508790417 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1458 microversion: 2.1 time: 0.801638 Feb 17 03:36:20.149925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-94773cc0-9aee-4796-ac33-22c401e0bc28 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Releasing lock "refresh_cache-307fa9d3-f0a5-4c33-aa27-7271e36ec239" {{(pid=98103) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:36:20.150885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-94773cc0-9aee-4796-ac33-22c401e0bc28 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "POST /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/action" status: 202 len: 0 microversion: 2.1 time: 3.485487 Feb 17 03:36:20.154735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 538/1070] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:16 2021] POST /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/action => generated 0 bytes in 3487 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 03:36:20.161742 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 533/1071] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:19 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1458 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:36:20.162262 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ebaff438-c3b5-495a-a75b-d99b08eb05b5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:20.163434 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ebaff438-c3b5-495a-a75b-d99b08eb05b5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:20.166865 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9b7f540c-aeaf-40d5-a218-d9c8d0cc5324 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Action: 'create', calling method: .version_select at 0x7f98aaff7048>, body: {"security_group": {"name": "tempest-TestMinimumBasicScenario-984020185", "description": "tempest-TestMinimumBasicScenario-984020185 description"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:20.174562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ebaff438-c3b5-495a-a75b-d99b08eb05b5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:20.175147 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ebaff438-c3b5-495a-a75b-d99b08eb05b5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:20.176022 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ebaff438-c3b5-495a-a75b-d99b08eb05b5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:20.176812 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ebaff438-c3b5-495a-a75b-d99b08eb05b5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:20.323970 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ebaff438-c3b5-495a-a75b-d99b08eb05b5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28175 microversion: 2.20 time: 0.170917 Feb 17 03:36:20.326757 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 539/1072] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:20 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28175 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:20.332038 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d2465f63-6e61-4973-9237-e426fbd13bc1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:20.332851 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d2465f63-6e61-4973-9237-e426fbd13bc1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:20.342438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d2465f63-6e61-4973-9237-e426fbd13bc1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:20.342954 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d2465f63-6e61-4973-9237-e426fbd13bc1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:20.343827 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d2465f63-6e61-4973-9237-e426fbd13bc1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:20.344326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d2465f63-6e61-4973-9237-e426fbd13bc1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:20.578343 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d2465f63-6e61-4973-9237-e426fbd13bc1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:20.588042 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d2465f63-6e61-4973-9237-e426fbd13bc1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1458 microversion: 2.1 time: 0.261859 Feb 17 03:36:20.588884 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 540/1073] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:20 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1458 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:20.613626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e0db5005-3895-4b82-bdde-43b92285d9ea tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Action: 'create', calling method: .version_select at 0x7f98b0416e18>, body: {"pool": null} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:20.820964 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9b7f540c-aeaf-40d5-a218-d9c8d0cc5324 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.657972 Feb 17 03:36:20.821907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 534/1074] 10.222.0.57 () {60 vars in 1170 bytes} [Wed Feb 17 03:36:20 2021] POST /compute/v2.1/os-security-groups => generated 255 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:20.827983 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-053f50dc-b616-43cc-9f98-ec73f4c04499 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-966324169", "imageRef": "27891a64-31b3-4754-87b4-bf609a12c59a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "196dd25e-6f79-49ea-bd1a-b88102e9bbe7"}], "security_groups": [{"name": "tempest-securitygroup--984515587"}], "key_name": "tempest-keypair-102674015", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:21.152011 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-053f50dc-b616-43cc-9f98-ec73f4c04499 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] validate_networks() for [('196dd25e-6f79-49ea-bd1a-b88102e9bbe7', None, None, None)] {{(pid=98104) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:36:21.974299 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-053f50dc-b616-43cc-9f98-ec73f4c04499 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Flavor limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:36:21.974860 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-053f50dc-b616-43cc-9f98-ec73f4c04499 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Image limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:36:21.975353 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-053f50dc-b616-43cc-9f98-ec73f4c04499 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Flavor pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:36:21.975819 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-053f50dc-b616-43cc-9f98-ec73f4c04499 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Image pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:36:21.976376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-053f50dc-b616-43cc-9f98-ec73f4c04499 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:36:21.986307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-053f50dc-b616-43cc-9f98-ec73f4c04499 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:21.988108 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-053f50dc-b616-43cc-9f98-ec73f4c04499 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:21.989806 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-053f50dc-b616-43cc-9f98-ec73f4c04499 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:21.990680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-053f50dc-b616-43cc-9f98-ec73f4c04499 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:22.010700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-053f50dc-b616-43cc-9f98-ec73f4c04499 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Getting quotas for project c568344bec0146c19c14571bff20a759. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:36:22.016240 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-053f50dc-b616-43cc-9f98-ec73f4c04499 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Getting quotas for user f60e8201ff554fefa20487ac8f981d07 and project c568344bec0146c19c14571bff20a759. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:36:22.028099 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-053f50dc-b616-43cc-9f98-ec73f4c04499 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Going to run 1 instances... {{(pid=98104) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:36:22.031427 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-053f50dc-b616-43cc-9f98-ec73f4c04499 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27891a64-31b3-4754-87b4-bf609a12c59a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:36:22.086827 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-053f50dc-b616-43cc-9f98-ec73f4c04499 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.263653 Feb 17 03:36:22.094526 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 535/1075] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:36:20 2021] POST /compute/v2.1/servers => generated 401 bytes in 1265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:36:22.094526 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bb321976-bcbf-4f52-af58-8e61a8f4f0a2 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Action: 'create', calling method: .version_select at 0x7f98aaff7d90>, body: {"security_group_rule": {"parent_group_id": "58316507-e2b9-47a8-8c80-bbda6482c459", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:22.341637 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bb321976-bcbf-4f52-af58-8e61a8f4f0a2 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.252521 Feb 17 03:36:22.342304 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 536/1076] 10.222.0.57 () {60 vars in 1185 bytes} [Wed Feb 17 03:36:22 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:22.349196 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f5d7e7c0-f730-496f-8823-a6ff0d67d003 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:22.350396 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f5d7e7c0-f730-496f-8823-a6ff0d67d003 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:22.360427 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f5d7e7c0-f730-496f-8823-a6ff0d67d003 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:22.360949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f5d7e7c0-f730-496f-8823-a6ff0d67d003 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:22.362071 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f5d7e7c0-f730-496f-8823-a6ff0d67d003 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:22.362577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f5d7e7c0-f730-496f-8823-a6ff0d67d003 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:22.496131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f5d7e7c0-f730-496f-8823-a6ff0d67d003 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28175 microversion: 2.20 time: 0.152399 Feb 17 03:36:22.496949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 537/1077] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:22 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28175 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:22.504038 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2d9bd7eb-a89c-429c-a3a8-abc53273f772 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:22.505365 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2d9bd7eb-a89c-429c-a3a8-abc53273f772 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:22.592598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2d9bd7eb-a89c-429c-a3a8-abc53273f772 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:22.601490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2d9bd7eb-a89c-429c-a3a8-abc53273f772 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 200 len: 1236 microversion: 2.1 time: 0.102417 Feb 17 03:36:22.602305 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 538/1078] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:22 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 1236 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:22.607422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1daef37e-3237-4f56-ab89-da76027dd551 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Action: 'create', calling method: .version_select at 0x7f98aafc0730>, body: {"security_group_rule": {"parent_group_id": "58316507-e2b9-47a8-8c80-bbda6482c459", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:22.850012 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1daef37e-3237-4f56-ab89-da76027dd551 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.246715 Feb 17 03:36:22.851083 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 539/1079] 10.222.0.57 () {60 vars in 1185 bytes} [Wed Feb 17 03:36:22 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:22.873614 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b0f00191-07b0-4cee-8ece-b07d0ed0673d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-984020185"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:22.876772 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b0f00191-07b0-4cee-8ece-b07d0ed0673d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:22.886138 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b0f00191-07b0-4cee-8ece-b07d0ed0673d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:22.886968 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b0f00191-07b0-4cee-8ece-b07d0ed0673d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:22.888655 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b0f00191-07b0-4cee-8ece-b07d0ed0673d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:22.889473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b0f00191-07b0-4cee-8ece-b07d0ed0673d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:23.047599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e0db5005-3895-4b82-bdde-43b92285d9ea tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.443394 Feb 17 03:36:23.048334 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 541/1080] 10.222.0.57 () {60 vars in 1160 bytes} [Wed Feb 17 03:36:20 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:36:23.059582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3b321fa2-e537-4292-bd04-4fb32b842718 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.0.128"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:23.061532 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3b321fa2-e537-4292-bd04-4fb32b842718 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:23.071421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3b321fa2-e537-4292-bd04-4fb32b842718 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:23.072028 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3b321fa2-e537-4292-bd04-4fb32b842718 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:23.072991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3b321fa2-e537-4292-bd04-4fb32b842718 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:23.073578 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3b321fa2-e537-4292-bd04-4fb32b842718 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:23.140315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.network.security_group_api [None req-b0f00191-07b0-4cee-8ece-b07d0ed0673d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Adding security group 58316507-e2b9-47a8-8c80-bbda6482c459 to port 88c76ccb-10fd-4edc-b372-9a3bad57e105 Feb 17 03:36:23.140690 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3b321fa2-e537-4292-bd04-4fb32b842718 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Acquired lock "refresh_cache-43a647e7-a66d-4254-9011-71ced47c3312" {{(pid=98103) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:36:24.427753 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b0f00191-07b0-4cee-8ece-b07d0ed0673d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "POST /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/action" status: 202 len: 0 microversion: 2.1 time: 1.567740 Feb 17 03:36:24.429329 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 540/1081] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:22 2021] POST /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/action => generated 0 bytes in 1571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:24.435785 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-df5a3502-ebaa-45ae-ad12-0bc60997508b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:24.437296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-df5a3502-ebaa-45ae-ad12-0bc60997508b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:24.450408 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-df5a3502-ebaa-45ae-ad12-0bc60997508b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:24.451262 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-df5a3502-ebaa-45ae-ad12-0bc60997508b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:24.452368 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-df5a3502-ebaa-45ae-ad12-0bc60997508b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:24.453109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-df5a3502-ebaa-45ae-ad12-0bc60997508b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:24.600778 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-df5a3502-ebaa-45ae-ad12-0bc60997508b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28175 microversion: 2.20 time: 0.169412 Feb 17 03:36:24.601774 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 541/1082] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:24 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28175 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:24.608736 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0a0581e0-a21a-4980-8744-9b4821c593ea tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:24.609622 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0a0581e0-a21a-4980-8744-9b4821c593ea tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:24.619757 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a0581e0-a21a-4980-8744-9b4821c593ea tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:24.620268 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a0581e0-a21a-4980-8744-9b4821c593ea tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:24.621480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a0581e0-a21a-4980-8744-9b4821c593ea tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:24.621983 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0a0581e0-a21a-4980-8744-9b4821c593ea tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:24.877194 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0a0581e0-a21a-4980-8744-9b4821c593ea tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:24.888662 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0a0581e0-a21a-4980-8744-9b4821c593ea tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 200 len: 1294 microversion: 2.1 time: 0.285082 Feb 17 03:36:24.890937 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 542/1083] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:24 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 1294 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:24.896235 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-54c0161d-02e5-42d4-8759-df2bf5cdd992 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:24.897133 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-54c0161d-02e5-42d4-8759-df2bf5cdd992 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:24.908273 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54c0161d-02e5-42d4-8759-df2bf5cdd992 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:24.909296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54c0161d-02e5-42d4-8759-df2bf5cdd992 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:24.910166 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54c0161d-02e5-42d4-8759-df2bf5cdd992 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:24.910664 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-54c0161d-02e5-42d4-8759-df2bf5cdd992 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:25.039614 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-3b321fa2-e537-4292-bd04-4fb32b842718 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 03:36:25.390485 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-54c0161d-02e5-42d4-8759-df2bf5cdd992 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:25.405803 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-54c0161d-02e5-42d4-8759-df2bf5cdd992 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1769 microversion: 2.1 time: 0.513419 Feb 17 03:36:25.406425 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 543/1084] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:24 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1769 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:25.416748 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-da7465f1-1ade-4c64-b8c6-805b9420104f req-5a847d69-4562-4a81-9d37-f032bd64e7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307fa9d3-f0a5-4c33-aa27-7271e36ec239", "tag": "88c76ccb-10fd-4edc-b372-9a3bad57e105"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:25.416748 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:36:25.416748 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:36:25.463589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-da7465f1-1ade-4c64-b8c6-805b9420104f req-5a847d69-4562-4a81-9d37-f032bd64e7e6 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:25.464102 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-da7465f1-1ade-4c64-b8c6-805b9420104f req-5a847d69-4562-4a81-9d37-f032bd64e7e6 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:25.504138 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-da7465f1-1ade-4c64-b8c6-805b9420104f req-5a847d69-4562-4a81-9d37-f032bd64e7e6 service nova] Creating event network-changed:88c76ccb-10fd-4edc-b372-9a3bad57e105 for instance 307fa9d3-f0a5-4c33-aa27-7271e36ec239 on hv-cinder-75994 Feb 17 03:36:25.520140 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-da7465f1-1ade-4c64-b8c6-805b9420104f req-5a847d69-4562-4a81-9d37-f032bd64e7e6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112097 Feb 17 03:36:25.521800 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 544/1085] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:36:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:25.528137 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-12ab8c0e-9bda-46c6-a5f9-167a11b45dd7 req-e8eaf746-4846-44a3-998c-932ec852b073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a647e7-a66d-4254-9011-71ced47c3312", "tag": "1eaf9637-4a5d-4be5-9bed-fd22ccba8da3"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:25.530027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:36:25.530027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:36:25.540906 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-12ab8c0e-9bda-46c6-a5f9-167a11b45dd7 req-e8eaf746-4846-44a3-998c-932ec852b073 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:25.541431 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-12ab8c0e-9bda-46c6-a5f9-167a11b45dd7 req-e8eaf746-4846-44a3-998c-932ec852b073 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:25.563655 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-12ab8c0e-9bda-46c6-a5f9-167a11b45dd7 req-e8eaf746-4846-44a3-998c-932ec852b073 service nova] Creating event network-changed:1eaf9637-4a5d-4be5-9bed-fd22ccba8da3 for instance 43a647e7-a66d-4254-9011-71ced47c3312 on hv-cinder-75994 Feb 17 03:36:25.569945 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-12ab8c0e-9bda-46c6-a5f9-167a11b45dd7 req-e8eaf746-4846-44a3-998c-932ec852b073 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046637 Feb 17 03:36:25.570284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 545/1086] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:36:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:25.624114 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f340eac8-863d-45cf-bbe4-e6849b9613c5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:25.626041 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f340eac8-863d-45cf-bbe4-e6849b9613c5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:25.638395 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f340eac8-863d-45cf-bbe4-e6849b9613c5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:25.639088 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f340eac8-863d-45cf-bbe4-e6849b9613c5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:25.641126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f340eac8-863d-45cf-bbe4-e6849b9613c5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:25.641788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f340eac8-863d-45cf-bbe4-e6849b9613c5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:25.805843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f340eac8-863d-45cf-bbe4-e6849b9613c5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28175 microversion: 2.20 time: 0.191010 Feb 17 03:36:25.811593 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 546/1087] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:25 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28175 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:25.910308 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-21f1f166-4978-4555-b6f4-8bcc0da4be77 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:25.911209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-21f1f166-4978-4555-b6f4-8bcc0da4be77 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:25.922480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-21f1f166-4978-4555-b6f4-8bcc0da4be77 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:25.923109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-21f1f166-4978-4555-b6f4-8bcc0da4be77 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:25.924094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-21f1f166-4978-4555-b6f4-8bcc0da4be77 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:25.924680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-21f1f166-4978-4555-b6f4-8bcc0da4be77 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:26.315298 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-3b321fa2-e537-4292-bd04-4fb32b842718 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Updating instance_info_cache with network_info: [{"id": "1eaf9637-4a5d-4be5-9bed-fd22ccba8da3", "address": "fa:16:3e:07:db:cc", "network": {"id": "3cb0cdf3-e2d2-4fae-b226-b086c7cc05ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1162730446-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "09f977ccc1e54aa6bfffd127c9a4be7d", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap1eaf9637-4a", "ovs_interfaceid": "1eaf9637-4a5d-4be5-9bed-fd22ccba8da3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 03:36:26.329452 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3b321fa2-e537-4292-bd04-4fb32b842718 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Releasing lock "refresh_cache-43a647e7-a66d-4254-9011-71ced47c3312" {{(pid=98103) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:36:26.331203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3b321fa2-e537-4292-bd04-4fb32b842718 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "POST /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312/action" status: 202 len: 0 microversion: 2.1 time: 3.275195 Feb 17 03:36:26.332494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 542/1088] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:23 2021] POST /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312/action => generated 0 bytes in 3277 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Feb 17 03:36:26.820479 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d2473560-7bb8-4298-b03d-8dcb3b3b7bf9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:26.821924 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d2473560-7bb8-4298-b03d-8dcb3b3b7bf9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:26.831697 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d2473560-7bb8-4298-b03d-8dcb3b3b7bf9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:26.832427 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d2473560-7bb8-4298-b03d-8dcb3b3b7bf9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:26.833581 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d2473560-7bb8-4298-b03d-8dcb3b3b7bf9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:26.834062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d2473560-7bb8-4298-b03d-8dcb3b3b7bf9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:26.980078 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d2473560-7bb8-4298-b03d-8dcb3b3b7bf9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28175 microversion: 2.20 time: 0.163053 Feb 17 03:36:26.981129 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 543/1089] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:26 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28175 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:27.058926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-21f1f166-4978-4555-b6f4-8bcc0da4be77 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:27.070426 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-21f1f166-4978-4555-b6f4-8bcc0da4be77 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 200 len: 1361 microversion: 2.1 time: 1.166702 Feb 17 03:36:27.071394 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 547/1090] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:25 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 1361 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:36:27.995620 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bc01b38a-b270-438a-b156-3da5f19bdaaf tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:27.996692 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bc01b38a-b270-438a-b156-3da5f19bdaaf tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:28.008719 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bc01b38a-b270-438a-b156-3da5f19bdaaf tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:28.009267 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bc01b38a-b270-438a-b156-3da5f19bdaaf tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:28.010157 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bc01b38a-b270-438a-b156-3da5f19bdaaf tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:28.010649 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bc01b38a-b270-438a-b156-3da5f19bdaaf tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:28.089365 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9a172365-b080-4d29-b0ac-3015870e3701 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:28.090167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9a172365-b080-4d29-b0ac-3015870e3701 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:28.099947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a172365-b080-4d29-b0ac-3015870e3701 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:28.100721 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a172365-b080-4d29-b0ac-3015870e3701 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:28.101577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a172365-b080-4d29-b0ac-3015870e3701 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:28.102260 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a172365-b080-4d29-b0ac-3015870e3701 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:28.146279 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bc01b38a-b270-438a-b156-3da5f19bdaaf tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28175 microversion: 2.20 time: 0.154661 Feb 17 03:36:28.147934 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 544/1091] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:27 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28175 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:29.039720 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9a172365-b080-4d29-b0ac-3015870e3701 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:29.051132 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9a172365-b080-4d29-b0ac-3015870e3701 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 200 len: 1361 microversion: 2.1 time: 0.966269 Feb 17 03:36:29.051764 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 548/1092] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:28 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 1361 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:29.161568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-22137050-923b-4f89-b528-a4a48e2d774a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:29.162722 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-22137050-923b-4f89-b528-a4a48e2d774a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:29.172941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-22137050-923b-4f89-b528-a4a48e2d774a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:29.173487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-22137050-923b-4f89-b528-a4a48e2d774a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:29.174380 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-22137050-923b-4f89-b528-a4a48e2d774a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:29.174868 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-22137050-923b-4f89-b528-a4a48e2d774a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:29.298530 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-22137050-923b-4f89-b528-a4a48e2d774a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28175 microversion: 2.20 time: 0.141333 Feb 17 03:36:29.304386 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 545/1093] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:29 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28175 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:29.386205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-a9df6057-8177-49a0-95ab-b9c7f9daa39f req-842fc9fd-97de-480f-b232-8932c63340f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94dff4c9-58ab-474c-97ba-cb0bcea04ac9", "tag": "69a3d64d-ffe3-4aa5-aaf3-41565f3dd68c"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:29.388127 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:36:29.388127 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:36:29.398767 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-a9df6057-8177-49a0-95ab-b9c7f9daa39f req-842fc9fd-97de-480f-b232-8932c63340f3 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:29.399419 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-a9df6057-8177-49a0-95ab-b9c7f9daa39f req-842fc9fd-97de-480f-b232-8932c63340f3 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:29.421881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-a9df6057-8177-49a0-95ab-b9c7f9daa39f req-842fc9fd-97de-480f-b232-8932c63340f3 service nova] Creating event network-changed:69a3d64d-ffe3-4aa5-aaf3-41565f3dd68c for instance 94dff4c9-58ab-474c-97ba-cb0bcea04ac9 on hv-cinder-75994 Feb 17 03:36:29.428958 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-a9df6057-8177-49a0-95ab-b9c7f9daa39f req-842fc9fd-97de-480f-b232-8932c63340f3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046728 Feb 17 03:36:29.430211 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 549/1094] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:36:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:30.069397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8ca23c39-0ca6-4530-898c-6269e3fa901a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:30.070164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8ca23c39-0ca6-4530-898c-6269e3fa901a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:30.079689 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ca23c39-0ca6-4530-898c-6269e3fa901a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:30.080212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ca23c39-0ca6-4530-898c-6269e3fa901a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:30.081127 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ca23c39-0ca6-4530-898c-6269e3fa901a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:30.081662 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ca23c39-0ca6-4530-898c-6269e3fa901a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:30.313756 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fdac3509-b664-42f6-b5c7-ac372c29aec8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:30.315694 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fdac3509-b664-42f6-b5c7-ac372c29aec8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:30.324940 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fdac3509-b664-42f6-b5c7-ac372c29aec8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:30.325765 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fdac3509-b664-42f6-b5c7-ac372c29aec8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:30.326560 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fdac3509-b664-42f6-b5c7-ac372c29aec8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:30.327115 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fdac3509-b664-42f6-b5c7-ac372c29aec8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:30.343146 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8ca23c39-0ca6-4530-898c-6269e3fa901a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:30.352257 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8ca23c39-0ca6-4530-898c-6269e3fa901a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 200 len: 1361 microversion: 2.1 time: 0.287273 Feb 17 03:36:30.353294 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 546/1095] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:30 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 1361 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:30.684664 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fdac3509-b664-42f6-b5c7-ac372c29aec8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28175 microversion: 2.20 time: 0.375465 Feb 17 03:36:30.685625 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 550/1096] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:30 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28175 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:31.373386 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c2d8897b-f4b7-4cb6-a4ca-e3ac12de5a2b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:31.373939 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c2d8897b-f4b7-4cb6-a4ca-e3ac12de5a2b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:31.383237 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c2d8897b-f4b7-4cb6-a4ca-e3ac12de5a2b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:31.383858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c2d8897b-f4b7-4cb6-a4ca-e3ac12de5a2b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:31.384817 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c2d8897b-f4b7-4cb6-a4ca-e3ac12de5a2b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:31.385326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c2d8897b-f4b7-4cb6-a4ca-e3ac12de5a2b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:31.626650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c2d8897b-f4b7-4cb6-a4ca-e3ac12de5a2b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:31.637704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c2d8897b-f4b7-4cb6-a4ca-e3ac12de5a2b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 200 len: 1361 microversion: 2.1 time: 0.269073 Feb 17 03:36:31.638311 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 547/1097] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:31 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 1361 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:31.698698 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-581ae360-c2b3-4e76-882f-569b7ff672e7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:31.700007 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-581ae360-c2b3-4e76-882f-569b7ff672e7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:31.709689 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-581ae360-c2b3-4e76-882f-569b7ff672e7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:31.710134 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-581ae360-c2b3-4e76-882f-569b7ff672e7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:31.710984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-581ae360-c2b3-4e76-882f-569b7ff672e7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:31.711570 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-581ae360-c2b3-4e76-882f-569b7ff672e7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:31.899546 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-581ae360-c2b3-4e76-882f-569b7ff672e7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28175 microversion: 2.20 time: 0.205827 Feb 17 03:36:31.900198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 551/1098] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:31 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28175 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:32.658151 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2e264ffe-af26-4ecc-a9bc-ed755d3b2407 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:32.658879 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2e264ffe-af26-4ecc-a9bc-ed755d3b2407 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:32.667232 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e264ffe-af26-4ecc-a9bc-ed755d3b2407 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:32.667792 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e264ffe-af26-4ecc-a9bc-ed755d3b2407 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:32.668651 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e264ffe-af26-4ecc-a9bc-ed755d3b2407 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:32.669217 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2e264ffe-af26-4ecc-a9bc-ed755d3b2407 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:32.897850 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2e264ffe-af26-4ecc-a9bc-ed755d3b2407 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:32.909686 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2e264ffe-af26-4ecc-a9bc-ed755d3b2407 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 200 len: 1361 microversion: 2.1 time: 0.256275 Feb 17 03:36:32.910110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 548/1099] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:32 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 1361 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:32.913445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0c8c2e7c-d1fc-4cab-b79d-b161f2ea8bd2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:32.914673 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0c8c2e7c-d1fc-4cab-b79d-b161f2ea8bd2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:32.924291 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c8c2e7c-d1fc-4cab-b79d-b161f2ea8bd2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:32.924799 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c8c2e7c-d1fc-4cab-b79d-b161f2ea8bd2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:32.925727 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c8c2e7c-d1fc-4cab-b79d-b161f2ea8bd2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:32.926217 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c8c2e7c-d1fc-4cab-b79d-b161f2ea8bd2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:33.074804 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0c8c2e7c-d1fc-4cab-b79d-b161f2ea8bd2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28175 microversion: 2.20 time: 0.165803 Feb 17 03:36:33.075594 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 552/1100] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:32 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28175 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:36:33.929121 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a30adbff-f911-4b92-914b-f6c874d5ad2f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:33.929849 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a30adbff-f911-4b92-914b-f6c874d5ad2f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:33.938367 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a30adbff-f911-4b92-914b-f6c874d5ad2f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:33.938872 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a30adbff-f911-4b92-914b-f6c874d5ad2f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:33.939720 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a30adbff-f911-4b92-914b-f6c874d5ad2f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:33.940210 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a30adbff-f911-4b92-914b-f6c874d5ad2f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:34.088509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-15ccef20-2057-46ad-9ca4-03d788947657 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:34.089726 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-15ccef20-2057-46ad-9ca4-03d788947657 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:34.101791 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-15ccef20-2057-46ad-9ca4-03d788947657 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:34.102162 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-15ccef20-2057-46ad-9ca4-03d788947657 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:34.103028 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-15ccef20-2057-46ad-9ca4-03d788947657 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:34.103520 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-15ccef20-2057-46ad-9ca4-03d788947657 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:34.172672 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a30adbff-f911-4b92-914b-f6c874d5ad2f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:34.182640 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a30adbff-f911-4b92-914b-f6c874d5ad2f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 200 len: 1361 microversion: 2.1 time: 0.258245 Feb 17 03:36:34.183249 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 549/1101] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:33 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:34.265701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-15ccef20-2057-46ad-9ca4-03d788947657 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28466 microversion: 2.20 time: 0.181567 Feb 17 03:36:34.266410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 553/1102] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:34 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28466 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:36:35.202467 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-04296d48-aa37-4f98-a0f3-76d967dd40e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:35.203225 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-04296d48-aa37-4f98-a0f3-76d967dd40e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:35.212264 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-04296d48-aa37-4f98-a0f3-76d967dd40e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:35.212762 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-04296d48-aa37-4f98-a0f3-76d967dd40e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:35.213680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-04296d48-aa37-4f98-a0f3-76d967dd40e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:35.214171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-04296d48-aa37-4f98-a0f3-76d967dd40e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:35.280447 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-65a76bc5-5adb-404b-b592-d36b0e85f9a9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:35.281639 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-65a76bc5-5adb-404b-b592-d36b0e85f9a9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:35.290777 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-65a76bc5-5adb-404b-b592-d36b0e85f9a9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:35.291272 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-65a76bc5-5adb-404b-b592-d36b0e85f9a9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:35.292122 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-65a76bc5-5adb-404b-b592-d36b0e85f9a9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:35.292730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-65a76bc5-5adb-404b-b592-d36b0e85f9a9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:35.432958 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-65a76bc5-5adb-404b-b592-d36b0e85f9a9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28466 microversion: 2.20 time: 0.157009 Feb 17 03:36:35.433718 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 554/1103] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:35 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28466 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:36:35.441480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-04296d48-aa37-4f98-a0f3-76d967dd40e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:35.450507 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-04296d48-aa37-4f98-a0f3-76d967dd40e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 200 len: 1361 microversion: 2.1 time: 0.252435 Feb 17 03:36:35.451094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 550/1104] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:35 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 1361 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:36.446794 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4ffed88e-f083-4350-97f7-46e1630fbc4d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:36.447988 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4ffed88e-f083-4350-97f7-46e1630fbc4d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:36.457762 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ffed88e-f083-4350-97f7-46e1630fbc4d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:36.458270 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ffed88e-f083-4350-97f7-46e1630fbc4d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:36.459124 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ffed88e-f083-4350-97f7-46e1630fbc4d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:36.459615 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4ffed88e-f083-4350-97f7-46e1630fbc4d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:36.469350 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-df8cba44-7a0c-46b7-a73b-0a0327bb110c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:36.470029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-df8cba44-7a0c-46b7-a73b-0a0327bb110c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:36.477978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-df8cba44-7a0c-46b7-a73b-0a0327bb110c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:36.478494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-df8cba44-7a0c-46b7-a73b-0a0327bb110c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:36.479339 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-df8cba44-7a0c-46b7-a73b-0a0327bb110c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:36.479831 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-df8cba44-7a0c-46b7-a73b-0a0327bb110c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:36.597231 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4ffed88e-f083-4350-97f7-46e1630fbc4d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.154943 Feb 17 03:36:36.597928 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 555/1105] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:36 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:36.697515 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-df8cba44-7a0c-46b7-a73b-0a0327bb110c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:36.706998 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-df8cba44-7a0c-46b7-a73b-0a0327bb110c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 200 len: 1361 microversion: 2.1 time: 0.241868 Feb 17 03:36:36.707599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 551/1106] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:36 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 1361 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:37.048286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-c2940bd5-4e1d-4aef-97a0-589fe9cb6db8 req-a4ff89c4-f7de-4620-924a-61733e98d8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94dff4c9-58ab-474c-97ba-cb0bcea04ac9", "name": "network-vif-plugged", "status": "completed", "tag": "69a3d64d-ffe3-4aa5-aaf3-41565f3dd68c"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:37.050552 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:36:37.050552 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:36:37.060367 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-c2940bd5-4e1d-4aef-97a0-589fe9cb6db8 req-a4ff89c4-f7de-4620-924a-61733e98d8c7 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:37.060871 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-c2940bd5-4e1d-4aef-97a0-589fe9cb6db8 req-a4ff89c4-f7de-4620-924a-61733e98d8c7 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:37.079514 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-c2940bd5-4e1d-4aef-97a0-589fe9cb6db8 req-a4ff89c4-f7de-4620-924a-61733e98d8c7 service nova] Creating event network-vif-plugged:69a3d64d-ffe3-4aa5-aaf3-41565f3dd68c for instance 94dff4c9-58ab-474c-97ba-cb0bcea04ac9 on hv-cinder-75994 Feb 17 03:36:37.084483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-c2940bd5-4e1d-4aef-97a0-589fe9cb6db8 req-a4ff89c4-f7de-4620-924a-61733e98d8c7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040810 Feb 17 03:36:37.085257 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 556/1107] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:36:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:37.610209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-10b69f6d-5c35-41ae-a15f-a6afcb1c2782 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:37.611309 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-10b69f6d-5c35-41ae-a15f-a6afcb1c2782 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:37.619366 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-10b69f6d-5c35-41ae-a15f-a6afcb1c2782 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:37.619878 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-10b69f6d-5c35-41ae-a15f-a6afcb1c2782 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:37.620729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-10b69f6d-5c35-41ae-a15f-a6afcb1c2782 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:37.621262 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-10b69f6d-5c35-41ae-a15f-a6afcb1c2782 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:37.726302 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-db4c9dd9-7e02-45f2-852a-69a8eb22a0e8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:37.726990 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-db4c9dd9-7e02-45f2-852a-69a8eb22a0e8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:37.735028 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-db4c9dd9-7e02-45f2-852a-69a8eb22a0e8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:37.735535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-db4c9dd9-7e02-45f2-852a-69a8eb22a0e8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:37.736366 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-db4c9dd9-7e02-45f2-852a-69a8eb22a0e8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:37.736853 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-db4c9dd9-7e02-45f2-852a-69a8eb22a0e8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:37.953084 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-db4c9dd9-7e02-45f2-852a-69a8eb22a0e8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:37.961988 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-db4c9dd9-7e02-45f2-852a-69a8eb22a0e8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 200 len: 1361 microversion: 2.1 time: 0.240466 Feb 17 03:36:37.962593 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 557/1108] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:37 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:37.972869 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-10b69f6d-5c35-41ae-a15f-a6afcb1c2782 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.366583 Feb 17 03:36:37.973644 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 552/1109] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:37 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:38.980254 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d03c449c-4652-4b87-9c46-4b7a038eb5cc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:38.980966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d03c449c-4652-4b87-9c46-4b7a038eb5cc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:38.985977 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-732defe8-86e3-4f50-8272-cef8f910c011 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:38.987133 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-732defe8-86e3-4f50-8272-cef8f910c011 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:38.989562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d03c449c-4652-4b87-9c46-4b7a038eb5cc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:38.990087 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d03c449c-4652-4b87-9c46-4b7a038eb5cc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:38.990947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d03c449c-4652-4b87-9c46-4b7a038eb5cc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:38.991442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d03c449c-4652-4b87-9c46-4b7a038eb5cc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:38.997067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-732defe8-86e3-4f50-8272-cef8f910c011 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:38.997600 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-732defe8-86e3-4f50-8272-cef8f910c011 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:38.998455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-732defe8-86e3-4f50-8272-cef8f910c011 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:38.998950 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-732defe8-86e3-4f50-8272-cef8f910c011 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:39.148077 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-732defe8-86e3-4f50-8272-cef8f910c011 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.166467 Feb 17 03:36:39.149218 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 553/1110] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:38 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:36:39.225675 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d03c449c-4652-4b87-9c46-4b7a038eb5cc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:39.234495 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d03c449c-4652-4b87-9c46-4b7a038eb5cc tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 200 len: 1361 microversion: 2.1 time: 0.258500 Feb 17 03:36:39.235097 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 558/1111] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:38 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:40.161781 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0c069c7e-a69f-49a4-8323-27f817fd72b5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:40.162944 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0c069c7e-a69f-49a4-8323-27f817fd72b5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:40.171743 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c069c7e-a69f-49a4-8323-27f817fd72b5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:40.172260 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c069c7e-a69f-49a4-8323-27f817fd72b5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:40.173208 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c069c7e-a69f-49a4-8323-27f817fd72b5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:40.173795 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c069c7e-a69f-49a4-8323-27f817fd72b5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:40.251919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b9360bc5-1a26-4cf6-88e8-4797eb3fe94a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:40.252578 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b9360bc5-1a26-4cf6-88e8-4797eb3fe94a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:40.261128 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b9360bc5-1a26-4cf6-88e8-4797eb3fe94a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:40.261638 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b9360bc5-1a26-4cf6-88e8-4797eb3fe94a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:40.262476 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b9360bc5-1a26-4cf6-88e8-4797eb3fe94a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:40.262965 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b9360bc5-1a26-4cf6-88e8-4797eb3fe94a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:40.298521 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0c069c7e-a69f-49a4-8323-27f817fd72b5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.140718 Feb 17 03:36:40.299898 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 554/1112] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:40 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:40.472801 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b9360bc5-1a26-4cf6-88e8-4797eb3fe94a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:36:40.481649 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b9360bc5-1a26-4cf6-88e8-4797eb3fe94a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 200 len: 1548 microversion: 2.1 time: 0.233699 Feb 17 03:36:40.482241 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 559/1113] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:36:40 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 1548 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:36:40.500260 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-20bc8c0b-e1bc-4d10-a3b9-eeb0e0b4b374 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:36:40.500913 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-20bc8c0b-e1bc-4d10-a3b9-eeb0e0b4b374 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:40.509978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-20bc8c0b-e1bc-4d10-a3b9-eeb0e0b4b374 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:40.510488 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-20bc8c0b-e1bc-4d10-a3b9-eeb0e0b4b374 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:40.511349 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-20bc8c0b-e1bc-4d10-a3b9-eeb0e0b4b374 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:40.511847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-20bc8c0b-e1bc-4d10-a3b9-eeb0e0b4b374 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:40.670735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-20bc8c0b-e1bc-4d10-a3b9-eeb0e0b4b374 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174994 Feb 17 03:36:40.671338 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 555/1114] 10.222.0.57 () {58 vars in 1265 bytes} [Wed Feb 17 03:36:40 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-interface => generated 285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:41.313524 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-85d9acac-28c1-4af7-b098-f89013f34072 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:41.314405 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-85d9acac-28c1-4af7-b098-f89013f34072 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:41.324395 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85d9acac-28c1-4af7-b098-f89013f34072 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:41.324996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85d9acac-28c1-4af7-b098-f89013f34072 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:41.325979 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85d9acac-28c1-4af7-b098-f89013f34072 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:41.326536 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-85d9acac-28c1-4af7-b098-f89013f34072 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:41.458640 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-85d9acac-28c1-4af7-b098-f89013f34072 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.150563 Feb 17 03:36:41.459358 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 560/1115] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:41 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:36:42.277689 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ddbe3007-ccde-4b82-8c6a-d52efd0e130b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:42.278959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ddbe3007-ccde-4b82-8c6a-d52efd0e130b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:42.279718 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-14867643-51ab-4a1c-b065-4a1aa33c438d req-41422801-5693-48a5-9d29-11a52da33250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94dff4c9-58ab-474c-97ba-cb0bcea04ac9", "tag": "69a3d64d-ffe3-4aa5-aaf3-41565f3dd68c"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:42.281623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:36:42.281623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:36:42.288534 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ddbe3007-ccde-4b82-8c6a-d52efd0e130b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:42.289247 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ddbe3007-ccde-4b82-8c6a-d52efd0e130b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:42.290318 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ddbe3007-ccde-4b82-8c6a-d52efd0e130b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:42.290814 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ddbe3007-ccde-4b82-8c6a-d52efd0e130b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:42.294370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-14867643-51ab-4a1c-b065-4a1aa33c438d req-41422801-5693-48a5-9d29-11a52da33250 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:42.294886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-14867643-51ab-4a1c-b065-4a1aa33c438d req-41422801-5693-48a5-9d29-11a52da33250 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:42.315875 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-14867643-51ab-4a1c-b065-4a1aa33c438d req-41422801-5693-48a5-9d29-11a52da33250 service nova] Creating event network-changed:69a3d64d-ffe3-4aa5-aaf3-41565f3dd68c for instance 94dff4c9-58ab-474c-97ba-cb0bcea04ac9 on hv-cinder-75994 Feb 17 03:36:42.322020 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-14867643-51ab-4a1c-b065-4a1aa33c438d req-41422801-5693-48a5-9d29-11a52da33250 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046507 Feb 17 03:36:42.322903 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 561/1116] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:36:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:36:42.430295 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ddbe3007-ccde-4b82-8c6a-d52efd0e130b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 14 microversion: 2.1 time: 0.157504 Feb 17 03:36:42.434533 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 556/1117] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:42 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:36:42.472817 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-52b10c96-73c8-49e2-826e-a03126aafc10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:42.474504 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-52b10c96-73c8-49e2-826e-a03126aafc10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:42.483744 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-52b10c96-73c8-49e2-826e-a03126aafc10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:42.484330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-52b10c96-73c8-49e2-826e-a03126aafc10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:42.485423 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-52b10c96-73c8-49e2-826e-a03126aafc10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:42.485917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-52b10c96-73c8-49e2-826e-a03126aafc10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:42.624635 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-52b10c96-73c8-49e2-826e-a03126aafc10 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.156472 Feb 17 03:36:42.626688 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 562/1118] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:42 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:36:43.444571 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7030e362-484a-4239-a91e-700684f19008 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:43.446778 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7030e362-484a-4239-a91e-700684f19008 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:43.456672 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7030e362-484a-4239-a91e-700684f19008 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:43.456873 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7030e362-484a-4239-a91e-700684f19008 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:43.458664 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7030e362-484a-4239-a91e-700684f19008 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:43.458781 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7030e362-484a-4239-a91e-700684f19008 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:43.606438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7030e362-484a-4239-a91e-700684f19008 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 14 microversion: 2.1 time: 0.166591 Feb 17 03:36:43.607153 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 557/1119] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:43 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:36:43.638577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0af49d60-5e81-4135-b839-27e9a75ac9dc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:43.639720 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0af49d60-5e81-4135-b839-27e9a75ac9dc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:43.649752 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0af49d60-5e81-4135-b839-27e9a75ac9dc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:43.650272 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0af49d60-5e81-4135-b839-27e9a75ac9dc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:43.651120 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0af49d60-5e81-4135-b839-27e9a75ac9dc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:43.651608 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0af49d60-5e81-4135-b839-27e9a75ac9dc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:43.796873 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0af49d60-5e81-4135-b839-27e9a75ac9dc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.162341 Feb 17 03:36:43.798740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 563/1120] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:43 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:44.620566 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-43adce22-cef2-45f1-9199-485a425f94e9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:44.621654 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-43adce22-cef2-45f1-9199-485a425f94e9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:44.630925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43adce22-cef2-45f1-9199-485a425f94e9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:44.631424 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43adce22-cef2-45f1-9199-485a425f94e9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:44.632257 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43adce22-cef2-45f1-9199-485a425f94e9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:44.632745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43adce22-cef2-45f1-9199-485a425f94e9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:44.767929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-43adce22-cef2-45f1-9199-485a425f94e9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 14 microversion: 2.1 time: 0.151969 Feb 17 03:36:44.769008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 558/1121] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:44 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:36:44.812766 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ee0d1034-bcf5-42cd-b890-75e4eda48fc0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:44.813973 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ee0d1034-bcf5-42cd-b890-75e4eda48fc0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:44.823590 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee0d1034-bcf5-42cd-b890-75e4eda48fc0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:44.824093 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee0d1034-bcf5-42cd-b890-75e4eda48fc0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:44.824979 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee0d1034-bcf5-42cd-b890-75e4eda48fc0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:44.825525 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ee0d1034-bcf5-42cd-b890-75e4eda48fc0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:44.976347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ee0d1034-bcf5-42cd-b890-75e4eda48fc0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.167944 Feb 17 03:36:44.977084 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 564/1122] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:44 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:45.781117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f235013a-c36f-4a20-abfd-f3a108f8fe45 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:45.782245 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f235013a-c36f-4a20-abfd-f3a108f8fe45 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:45.791423 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f235013a-c36f-4a20-abfd-f3a108f8fe45 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:45.791923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f235013a-c36f-4a20-abfd-f3a108f8fe45 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:45.792751 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f235013a-c36f-4a20-abfd-f3a108f8fe45 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:45.793298 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f235013a-c36f-4a20-abfd-f3a108f8fe45 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:45.928198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f235013a-c36f-4a20-abfd-f3a108f8fe45 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 14 microversion: 2.1 time: 0.151571 Feb 17 03:36:45.928891 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 559/1123] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:45 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:36:45.988826 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8cc41d40-777c-4243-a058-a4983b26cc00 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:45.989981 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8cc41d40-777c-4243-a058-a4983b26cc00 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:45.998475 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8cc41d40-777c-4243-a058-a4983b26cc00 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:45.998979 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8cc41d40-777c-4243-a058-a4983b26cc00 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:46.000004 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8cc41d40-777c-4243-a058-a4983b26cc00 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:46.000535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8cc41d40-777c-4243-a058-a4983b26cc00 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:46.126232 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8cc41d40-777c-4243-a058-a4983b26cc00 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.141711 Feb 17 03:36:46.127200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 565/1124] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:45 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:46.941169 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0aed8835-a8f2-4776-86d4-799be7e52ae0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:46.942328 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0aed8835-a8f2-4776-86d4-799be7e52ae0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:46.951132 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0aed8835-a8f2-4776-86d4-799be7e52ae0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:46.951640 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0aed8835-a8f2-4776-86d4-799be7e52ae0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:46.952483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0aed8835-a8f2-4776-86d4-799be7e52ae0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:46.953164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0aed8835-a8f2-4776-86d4-799be7e52ae0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:47.074755 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0aed8835-a8f2-4776-86d4-799be7e52ae0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 14 microversion: 2.1 time: 0.138420 Feb 17 03:36:47.075444 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 560/1125] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:46 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:36:47.140277 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f4d51a5d-1429-4f37-a602-5f17225ddcc6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:47.141452 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f4d51a5d-1429-4f37-a602-5f17225ddcc6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:47.150163 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4d51a5d-1429-4f37-a602-5f17225ddcc6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:47.150611 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4d51a5d-1429-4f37-a602-5f17225ddcc6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:47.151463 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4d51a5d-1429-4f37-a602-5f17225ddcc6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:47.152008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4d51a5d-1429-4f37-a602-5f17225ddcc6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:47.274447 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f4d51a5d-1429-4f37-a602-5f17225ddcc6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.138723 Feb 17 03:36:47.275372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 566/1126] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:47 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:48.086584 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9fbce28a-8990-44ff-a77f-4a6213a335d6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:48.087767 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9fbce28a-8990-44ff-a77f-4a6213a335d6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:48.096435 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9fbce28a-8990-44ff-a77f-4a6213a335d6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:48.096936 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9fbce28a-8990-44ff-a77f-4a6213a335d6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:48.097798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9fbce28a-8990-44ff-a77f-4a6213a335d6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:48.098286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9fbce28a-8990-44ff-a77f-4a6213a335d6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:48.222479 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9fbce28a-8990-44ff-a77f-4a6213a335d6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 14 microversion: 2.1 time: 0.140290 Feb 17 03:36:48.223163 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 561/1127] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:48 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:36:48.288140 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-020f2f8b-c406-4478-bc90-c471fa0a0b4d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:48.289413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-020f2f8b-c406-4478-bc90-c471fa0a0b4d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:48.297943 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-020f2f8b-c406-4478-bc90-c471fa0a0b4d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:48.298451 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-020f2f8b-c406-4478-bc90-c471fa0a0b4d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:48.299295 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-020f2f8b-c406-4478-bc90-c471fa0a0b4d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:48.300424 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-020f2f8b-c406-4478-bc90-c471fa0a0b4d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:48.429095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-020f2f8b-c406-4478-bc90-c471fa0a0b4d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.145760 Feb 17 03:36:48.429821 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 567/1128] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:48 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:49.235051 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2ef5f883-12d7-4090-8ab1-051c58eecc20 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:49.236126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2ef5f883-12d7-4090-8ab1-051c58eecc20 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:49.244785 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ef5f883-12d7-4090-8ab1-051c58eecc20 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:49.245325 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ef5f883-12d7-4090-8ab1-051c58eecc20 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:49.246164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ef5f883-12d7-4090-8ab1-051c58eecc20 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:49.246657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ef5f883-12d7-4090-8ab1-051c58eecc20 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:49.366343 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2ef5f883-12d7-4090-8ab1-051c58eecc20 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 14 microversion: 2.1 time: 0.135767 Feb 17 03:36:49.367029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 562/1129] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:49 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:36:49.442913 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-07c1ce84-1ce7-47a8-84b6-a8cacc636dcc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:49.444105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-07c1ce84-1ce7-47a8-84b6-a8cacc636dcc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:49.453206 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07c1ce84-1ce7-47a8-84b6-a8cacc636dcc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:49.453709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07c1ce84-1ce7-47a8-84b6-a8cacc636dcc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:49.454543 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07c1ce84-1ce7-47a8-84b6-a8cacc636dcc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:49.455029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07c1ce84-1ce7-47a8-84b6-a8cacc636dcc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:49.614968 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-07c1ce84-1ce7-47a8-84b6-a8cacc636dcc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.176822 Feb 17 03:36:49.615567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 568/1130] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:49 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:50.379328 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-72a31eb0-7f0a-4ad0-99ed-123ebb833676 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:50.380525 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-72a31eb0-7f0a-4ad0-99ed-123ebb833676 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:50.389198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-72a31eb0-7f0a-4ad0-99ed-123ebb833676 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:50.389705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-72a31eb0-7f0a-4ad0-99ed-123ebb833676 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:50.390551 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-72a31eb0-7f0a-4ad0-99ed-123ebb833676 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:50.391041 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-72a31eb0-7f0a-4ad0-99ed-123ebb833676 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:50.512977 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-72a31eb0-7f0a-4ad0-99ed-123ebb833676 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 14 microversion: 2.1 time: 0.138615 Feb 17 03:36:50.513705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 563/1131] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:50 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:36:50.628951 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d21cc6dc-764b-4c5e-aed4-97354fbba765 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:50.630118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d21cc6dc-764b-4c5e-aed4-97354fbba765 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:50.638650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d21cc6dc-764b-4c5e-aed4-97354fbba765 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:50.639158 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d21cc6dc-764b-4c5e-aed4-97354fbba765 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:50.640000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d21cc6dc-764b-4c5e-aed4-97354fbba765 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:50.640498 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d21cc6dc-764b-4c5e-aed4-97354fbba765 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:50.771996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d21cc6dc-764b-4c5e-aed4-97354fbba765 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.147749 Feb 17 03:36:50.773053 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 569/1132] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:50 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:51.525908 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c3fa62a8-a6e1-4cf8-b019-3b2b1e7d83c0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:51.527045 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c3fa62a8-a6e1-4cf8-b019-3b2b1e7d83c0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:51.535549 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3fa62a8-a6e1-4cf8-b019-3b2b1e7d83c0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:51.536057 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3fa62a8-a6e1-4cf8-b019-3b2b1e7d83c0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:51.536883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3fa62a8-a6e1-4cf8-b019-3b2b1e7d83c0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:51.537398 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3fa62a8-a6e1-4cf8-b019-3b2b1e7d83c0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:51.678085 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c3fa62a8-a6e1-4cf8-b019-3b2b1e7d83c0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 1720 microversion: 2.1 time: 0.156494 Feb 17 03:36:51.678792 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 564/1133] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:51 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:36:51.786197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e804b075-b70f-4941-b6ba-79b0bbca087d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:51.787280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e804b075-b70f-4941-b6ba-79b0bbca087d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:51.795814 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e804b075-b70f-4941-b6ba-79b0bbca087d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:51.796415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e804b075-b70f-4941-b6ba-79b0bbca087d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:51.797215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e804b075-b70f-4941-b6ba-79b0bbca087d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:51.797710 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e804b075-b70f-4941-b6ba-79b0bbca087d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:51.935387 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e804b075-b70f-4941-b6ba-79b0bbca087d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.153661 Feb 17 03:36:51.936105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 570/1134] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:51 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:52.691668 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3d678490-0d6b-40c9-8dd7-90a63fc55449 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:52.692809 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3d678490-0d6b-40c9-8dd7-90a63fc55449 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:52.702025 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3d678490-0d6b-40c9-8dd7-90a63fc55449 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:52.702533 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3d678490-0d6b-40c9-8dd7-90a63fc55449 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:52.703370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3d678490-0d6b-40c9-8dd7-90a63fc55449 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:52.703855 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3d678490-0d6b-40c9-8dd7-90a63fc55449 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:52.835289 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3d678490-0d6b-40c9-8dd7-90a63fc55449 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 15025 microversion: 2.1 time: 0.148086 Feb 17 03:36:52.836006 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 565/1135] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:52 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 15025 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:36:52.949220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a5f88fc5-b714-4244-889d-d4c2de7d4f1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:52.950300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a5f88fc5-b714-4244-889d-d4c2de7d4f1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:52.959588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5f88fc5-b714-4244-889d-d4c2de7d4f1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:52.960101 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5f88fc5-b714-4244-889d-d4c2de7d4f1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:52.960954 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5f88fc5-b714-4244-889d-d4c2de7d4f1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:52.961480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5f88fc5-b714-4244-889d-d4c2de7d4f1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:53.083724 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a5f88fc5-b714-4244-889d-d4c2de7d4f1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.139167 Feb 17 03:36:53.084436 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 571/1136] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:52 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:53.848328 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7ec80011-4b0c-4e0e-b906-f250797bf1f4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:53.849559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7ec80011-4b0c-4e0e-b906-f250797bf1f4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:53.859042 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7ec80011-4b0c-4e0e-b906-f250797bf1f4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:53.859522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7ec80011-4b0c-4e0e-b906-f250797bf1f4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:53.860388 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7ec80011-4b0c-4e0e-b906-f250797bf1f4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:53.860917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7ec80011-4b0c-4e0e-b906-f250797bf1f4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:53.995609 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7ec80011-4b0c-4e0e-b906-f250797bf1f4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 18561 microversion: 2.1 time: 0.151667 Feb 17 03:36:53.996340 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 566/1137] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:53 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 18561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:36:54.096975 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d5bab65e-2350-43c3-b191-2f7d1e693b35 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:54.098290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d5bab65e-2350-43c3-b191-2f7d1e693b35 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:54.107225 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d5bab65e-2350-43c3-b191-2f7d1e693b35 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:54.107673 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d5bab65e-2350-43c3-b191-2f7d1e693b35 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:54.108560 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d5bab65e-2350-43c3-b191-2f7d1e693b35 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:54.109158 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d5bab65e-2350-43c3-b191-2f7d1e693b35 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:54.247862 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d5bab65e-2350-43c3-b191-2f7d1e693b35 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.155400 Feb 17 03:36:54.248610 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 572/1138] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:54 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:55.009395 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2ae32a8c-fe8a-48a4-9f5f-769e5748cc50 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:55.010547 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2ae32a8c-fe8a-48a4-9f5f-769e5748cc50 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:55.019200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ae32a8c-fe8a-48a4-9f5f-769e5748cc50 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:55.019711 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ae32a8c-fe8a-48a4-9f5f-769e5748cc50 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:55.020555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ae32a8c-fe8a-48a4-9f5f-769e5748cc50 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:55.021092 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ae32a8c-fe8a-48a4-9f5f-769e5748cc50 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:55.179637 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2ae32a8c-fe8a-48a4-9f5f-769e5748cc50 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 19944 microversion: 2.1 time: 0.174494 Feb 17 03:36:55.180297 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 567/1139] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:55 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 19944 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:36:55.261061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1e3dbfd9-c2d5-4725-bf7b-2e310f12abda tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:55.262265 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1e3dbfd9-c2d5-4725-bf7b-2e310f12abda tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:55.270842 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e3dbfd9-c2d5-4725-bf7b-2e310f12abda tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:55.271354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e3dbfd9-c2d5-4725-bf7b-2e310f12abda tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:55.272203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e3dbfd9-c2d5-4725-bf7b-2e310f12abda tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:55.272701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e3dbfd9-c2d5-4725-bf7b-2e310f12abda tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:55.398752 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1e3dbfd9-c2d5-4725-bf7b-2e310f12abda tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.142095 Feb 17 03:36:55.399436 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 573/1140] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:55 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:56.192602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f66bff27-2f95-4aae-8e89-1d3fff4dcade tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:56.193689 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f66bff27-2f95-4aae-8e89-1d3fff4dcade tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:56.202550 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f66bff27-2f95-4aae-8e89-1d3fff4dcade tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:56.203051 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f66bff27-2f95-4aae-8e89-1d3fff4dcade tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:56.203884 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f66bff27-2f95-4aae-8e89-1d3fff4dcade tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:56.204368 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f66bff27-2f95-4aae-8e89-1d3fff4dcade tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:56.334203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f66bff27-2f95-4aae-8e89-1d3fff4dcade tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 22716 microversion: 2.1 time: 0.146059 Feb 17 03:36:56.334921 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 568/1141] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:56 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 22716 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:36:56.412948 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-644a80ae-21fc-445a-adb2-92e2d05ab135 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:56.414254 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-644a80ae-21fc-445a-adb2-92e2d05ab135 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:56.423047 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-644a80ae-21fc-445a-adb2-92e2d05ab135 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:56.423678 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-644a80ae-21fc-445a-adb2-92e2d05ab135 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:56.424523 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-644a80ae-21fc-445a-adb2-92e2d05ab135 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:56.425018 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-644a80ae-21fc-445a-adb2-92e2d05ab135 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:56.546560 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-644a80ae-21fc-445a-adb2-92e2d05ab135 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.138555 Feb 17 03:36:56.547207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 574/1142] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:56 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:36:57.347871 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1996924f-663b-4135-90f6-c5310ac9cfda tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:57.349016 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1996924f-663b-4135-90f6-c5310ac9cfda tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:57.357705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1996924f-663b-4135-90f6-c5310ac9cfda tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:57.358209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1996924f-663b-4135-90f6-c5310ac9cfda tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:57.359063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1996924f-663b-4135-90f6-c5310ac9cfda tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:57.359551 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1996924f-663b-4135-90f6-c5310ac9cfda tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:57.510469 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1996924f-663b-4135-90f6-c5310ac9cfda tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 23913 microversion: 2.1 time: 0.167320 Feb 17 03:36:57.511113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 569/1143] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:57 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 23913 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:36:57.560198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bf29c574-3dcb-4558-a97b-17b82cc2f2ee tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:57.561395 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bf29c574-3dcb-4558-a97b-17b82cc2f2ee tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:57.571670 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bf29c574-3dcb-4558-a97b-17b82cc2f2ee tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:57.572183 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bf29c574-3dcb-4558-a97b-17b82cc2f2ee tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:57.573059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bf29c574-3dcb-4558-a97b-17b82cc2f2ee tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:57.573585 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bf29c574-3dcb-4558-a97b-17b82cc2f2ee tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:57.711064 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bf29c574-3dcb-4558-a97b-17b82cc2f2ee tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.155180 Feb 17 03:36:57.711814 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 575/1144] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:57 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:58.523304 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d68db966-4783-43a8-b288-56f0c10899c3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:58.524961 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d68db966-4783-43a8-b288-56f0c10899c3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:58.534066 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d68db966-4783-43a8-b288-56f0c10899c3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:58.534572 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d68db966-4783-43a8-b288-56f0c10899c3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:58.535400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d68db966-4783-43a8-b288-56f0c10899c3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:58.535885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d68db966-4783-43a8-b288-56f0c10899c3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:58.661955 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d68db966-4783-43a8-b288-56f0c10899c3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 25796 microversion: 2.1 time: 0.142999 Feb 17 03:36:58.662912 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 570/1145] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:58 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 25796 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:36:58.724224 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9e8cc45b-5585-40db-819e-b869a9b07b02 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:58.725403 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9e8cc45b-5585-40db-819e-b869a9b07b02 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:58.734078 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9e8cc45b-5585-40db-819e-b869a9b07b02 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:58.734588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9e8cc45b-5585-40db-819e-b869a9b07b02 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:58.735433 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9e8cc45b-5585-40db-819e-b869a9b07b02 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:58.735937 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9e8cc45b-5585-40db-819e-b869a9b07b02 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:58.862792 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9e8cc45b-5585-40db-819e-b869a9b07b02 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.142758 Feb 17 03:36:58.864074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 576/1146] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:58 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:36:59.674760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e59c0840-76dc-4ae9-b7b1-088542767fb7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:59.675911 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e59c0840-76dc-4ae9-b7b1-088542767fb7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:59.684991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e59c0840-76dc-4ae9-b7b1-088542767fb7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:59.685551 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e59c0840-76dc-4ae9-b7b1-088542767fb7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:59.686400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e59c0840-76dc-4ae9-b7b1-088542767fb7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:59.686896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e59c0840-76dc-4ae9-b7b1-088542767fb7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:59.824332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e59c0840-76dc-4ae9-b7b1-088542767fb7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 27134 microversion: 2.1 time: 0.153885 Feb 17 03:36:59.825067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 571/1147] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:36:59 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 27134 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:36:59.876910 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e2e06928-d899-4f36-a08f-4001248d3dce tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:36:59.878584 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e2e06928-d899-4f36-a08f-4001248d3dce tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:36:59.887065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2e06928-d899-4f36-a08f-4001248d3dce tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:59.887577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2e06928-d899-4f36-a08f-4001248d3dce tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:36:59.888435 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2e06928-d899-4f36-a08f-4001248d3dce tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:36:59.888932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2e06928-d899-4f36-a08f-4001248d3dce tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:00.029330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e2e06928-d899-4f36-a08f-4001248d3dce tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.156848 Feb 17 03:37:00.030012 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 577/1148] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:36:59 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:00.838110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-72a75ead-1540-445a-8cc2-a4b5d1bde9ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:00.839301 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-72a75ead-1540-445a-8cc2-a4b5d1bde9ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:00.848589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-72a75ead-1540-445a-8cc2-a4b5d1bde9ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:00.849112 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-72a75ead-1540-445a-8cc2-a4b5d1bde9ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:00.849962 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-72a75ead-1540-445a-8cc2-a4b5d1bde9ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:00.850468 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-72a75ead-1540-445a-8cc2-a4b5d1bde9ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:00.994021 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-72a75ead-1540-445a-8cc2-a4b5d1bde9ac tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 27747 microversion: 2.1 time: 0.160336 Feb 17 03:37:00.994728 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 572/1149] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:00 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 27747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:01.042482 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-72eff979-df99-4f73-b857-a16dab3d7854 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:01.043634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-72eff979-df99-4f73-b857-a16dab3d7854 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:01.052282 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-72eff979-df99-4f73-b857-a16dab3d7854 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:01.052797 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-72eff979-df99-4f73-b857-a16dab3d7854 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:01.053661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-72eff979-df99-4f73-b857-a16dab3d7854 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:01.054163 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-72eff979-df99-4f73-b857-a16dab3d7854 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:01.182477 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-72eff979-df99-4f73-b857-a16dab3d7854 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.144386 Feb 17 03:37:01.183200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 578/1150] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:01 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:02.007654 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-362ee71e-82e5-4f90-941a-0e27703348b7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:02.008803 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-362ee71e-82e5-4f90-941a-0e27703348b7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:02.017399 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-362ee71e-82e5-4f90-941a-0e27703348b7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:02.017911 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-362ee71e-82e5-4f90-941a-0e27703348b7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:02.019410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-362ee71e-82e5-4f90-941a-0e27703348b7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:02.019899 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-362ee71e-82e5-4f90-941a-0e27703348b7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:02.148202 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-362ee71e-82e5-4f90-941a-0e27703348b7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28119 microversion: 2.1 time: 0.145289 Feb 17 03:37:02.148957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 573/1151] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:02 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28119 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:02.195741 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fd32a48e-6434-417c-adfd-d2f02af9da51 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:02.197348 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fd32a48e-6434-417c-adfd-d2f02af9da51 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:02.206085 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fd32a48e-6434-417c-adfd-d2f02af9da51 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:02.206598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fd32a48e-6434-417c-adfd-d2f02af9da51 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:02.207441 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fd32a48e-6434-417c-adfd-d2f02af9da51 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:02.207938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fd32a48e-6434-417c-adfd-d2f02af9da51 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:02.343179 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fd32a48e-6434-417c-adfd-d2f02af9da51 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.152446 Feb 17 03:37:02.343891 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 579/1152] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:02 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:03.162110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2050dc29-a9ee-4b86-80e8-5c0df2e4b5d0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:03.163189 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2050dc29-a9ee-4b86-80e8-5c0df2e4b5d0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:03.171778 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2050dc29-a9ee-4b86-80e8-5c0df2e4b5d0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:03.172287 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2050dc29-a9ee-4b86-80e8-5c0df2e4b5d0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:03.173151 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2050dc29-a9ee-4b86-80e8-5c0df2e4b5d0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:03.173649 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2050dc29-a9ee-4b86-80e8-5c0df2e4b5d0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:03.299639 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2050dc29-a9ee-4b86-80e8-5c0df2e4b5d0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28236 microversion: 2.1 time: 0.142559 Feb 17 03:37:03.300618 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 574/1153] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:03 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28236 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:03.356306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1fa7613e-c186-4b96-9cff-87c80aa4af79 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:03.357464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1fa7613e-c186-4b96-9cff-87c80aa4af79 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:03.365934 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1fa7613e-c186-4b96-9cff-87c80aa4af79 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:03.366436 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1fa7613e-c186-4b96-9cff-87c80aa4af79 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:03.367265 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1fa7613e-c186-4b96-9cff-87c80aa4af79 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:03.367760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1fa7613e-c186-4b96-9cff-87c80aa4af79 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:03.501589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1fa7613e-c186-4b96-9cff-87c80aa4af79 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.149531 Feb 17 03:37:03.502138 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 580/1154] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:03 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:04.312909 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6b574ed4-937a-4f25-a8fa-91be9a182c7a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:04.314268 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6b574ed4-937a-4f25-a8fa-91be9a182c7a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:04.322866 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6b574ed4-937a-4f25-a8fa-91be9a182c7a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:04.323366 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6b574ed4-937a-4f25-a8fa-91be9a182c7a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:04.324198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6b574ed4-937a-4f25-a8fa-91be9a182c7a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:04.324684 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6b574ed4-937a-4f25-a8fa-91be9a182c7a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:04.457798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6b574ed4-937a-4f25-a8fa-91be9a182c7a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28236 microversion: 2.1 time: 0.149263 Feb 17 03:37:04.458512 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 575/1155] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:04 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28236 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:04.514617 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-be0554c1-a365-4ba1-837b-5a8019748504 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:04.515767 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-be0554c1-a365-4ba1-837b-5a8019748504 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:04.524827 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be0554c1-a365-4ba1-837b-5a8019748504 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:04.525365 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be0554c1-a365-4ba1-837b-5a8019748504 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:04.526205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be0554c1-a365-4ba1-837b-5a8019748504 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:04.526700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be0554c1-a365-4ba1-837b-5a8019748504 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:04.646555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-be0554c1-a365-4ba1-837b-5a8019748504 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.136299 Feb 17 03:37:04.647258 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 581/1156] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:04 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:05.471417 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cbd7f33c-07b8-4e2c-8613-2068a5040635 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:05.472486 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cbd7f33c-07b8-4e2c-8613-2068a5040635 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:05.481852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cbd7f33c-07b8-4e2c-8613-2068a5040635 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:05.482363 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cbd7f33c-07b8-4e2c-8613-2068a5040635 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:05.483213 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cbd7f33c-07b8-4e2c-8613-2068a5040635 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:05.483704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cbd7f33c-07b8-4e2c-8613-2068a5040635 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:05.616648 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cbd7f33c-07b8-4e2c-8613-2068a5040635 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28236 microversion: 2.1 time: 0.150054 Feb 17 03:37:05.617404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 576/1157] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:05 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28236 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:05.659767 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-833475ed-8df4-4159-967b-0bcd753353d7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:05.660905 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-833475ed-8df4-4159-967b-0bcd753353d7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:05.669519 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-833475ed-8df4-4159-967b-0bcd753353d7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:05.670024 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-833475ed-8df4-4159-967b-0bcd753353d7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:05.670863 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-833475ed-8df4-4159-967b-0bcd753353d7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:05.671652 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-833475ed-8df4-4159-967b-0bcd753353d7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:05.798280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-833475ed-8df4-4159-967b-0bcd753353d7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.142829 Feb 17 03:37:05.798906 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 582/1158] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:05 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:06.629062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b87d3dfa-defa-491f-a0d6-21e1e2be9a71 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:06.630199 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b87d3dfa-defa-491f-a0d6-21e1e2be9a71 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:06.638874 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b87d3dfa-defa-491f-a0d6-21e1e2be9a71 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:06.639384 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b87d3dfa-defa-491f-a0d6-21e1e2be9a71 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:06.640235 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b87d3dfa-defa-491f-a0d6-21e1e2be9a71 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:06.640729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b87d3dfa-defa-491f-a0d6-21e1e2be9a71 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:06.759915 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b87d3dfa-defa-491f-a0d6-21e1e2be9a71 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28236 microversion: 2.1 time: 0.135276 Feb 17 03:37:06.760619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 577/1159] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:06 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28236 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:06.812551 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9a9d7b4f-1f2d-4706-9e9d-4a892d5afcc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:06.813720 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9a9d7b4f-1f2d-4706-9e9d-4a892d5afcc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:06.823200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a9d7b4f-1f2d-4706-9e9d-4a892d5afcc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:06.823710 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a9d7b4f-1f2d-4706-9e9d-4a892d5afcc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:06.824549 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a9d7b4f-1f2d-4706-9e9d-4a892d5afcc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:06.825066 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a9d7b4f-1f2d-4706-9e9d-4a892d5afcc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:06.948458 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9a9d7b4f-1f2d-4706-9e9d-4a892d5afcc4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.140839 Feb 17 03:37:06.949201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 583/1160] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:06 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:07.773113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-468eff45-df74-4fcc-a5d8-3d36d1392d81 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:07.774260 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-468eff45-df74-4fcc-a5d8-3d36d1392d81 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:07.782845 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-468eff45-df74-4fcc-a5d8-3d36d1392d81 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:07.783351 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-468eff45-df74-4fcc-a5d8-3d36d1392d81 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:07.784694 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-468eff45-df74-4fcc-a5d8-3d36d1392d81 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:07.785207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-468eff45-df74-4fcc-a5d8-3d36d1392d81 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:07.921683 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-468eff45-df74-4fcc-a5d8-3d36d1392d81 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28236 microversion: 2.1 time: 0.152885 Feb 17 03:37:07.922403 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 578/1161] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:07 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28236 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:07.961306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-40cacf1e-d556-4403-8efa-6331ad305dd7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:07.962501 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-40cacf1e-d556-4403-8efa-6331ad305dd7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:07.970793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-40cacf1e-d556-4403-8efa-6331ad305dd7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:07.971807 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-40cacf1e-d556-4403-8efa-6331ad305dd7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:07.972651 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-40cacf1e-d556-4403-8efa-6331ad305dd7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:07.973170 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-40cacf1e-d556-4403-8efa-6331ad305dd7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:08.097618 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-40cacf1e-d556-4403-8efa-6331ad305dd7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.139869 Feb 17 03:37:08.098484 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 584/1162] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:07 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:08.935650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7e434cc6-0df3-430e-a68b-10f923a2597a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:08.936813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7e434cc6-0df3-430e-a68b-10f923a2597a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:08.946539 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7e434cc6-0df3-430e-a68b-10f923a2597a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:08.947100 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7e434cc6-0df3-430e-a68b-10f923a2597a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:08.947948 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7e434cc6-0df3-430e-a68b-10f923a2597a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:08.948444 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7e434cc6-0df3-430e-a68b-10f923a2597a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:09.077112 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7e434cc6-0df3-430e-a68b-10f923a2597a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28236 microversion: 2.1 time: 0.145883 Feb 17 03:37:09.077826 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 579/1163] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:08 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28236 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:09.110330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ad01d309-c533-42d2-abdf-0142d35b52d1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:09.111476 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ad01d309-c533-42d2-abdf-0142d35b52d1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:09.120513 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad01d309-c533-42d2-abdf-0142d35b52d1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:09.121019 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad01d309-c533-42d2-abdf-0142d35b52d1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:09.121892 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad01d309-c533-42d2-abdf-0142d35b52d1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:09.122386 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad01d309-c533-42d2-abdf-0142d35b52d1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:09.256716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ad01d309-c533-42d2-abdf-0142d35b52d1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.150726 Feb 17 03:37:09.257378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 585/1164] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:09 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:10.090317 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f2d574cb-4ade-4252-878e-b617a3444224 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:10.091463 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f2d574cb-4ade-4252-878e-b617a3444224 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:10.100313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f2d574cb-4ade-4252-878e-b617a3444224 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:10.100819 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f2d574cb-4ade-4252-878e-b617a3444224 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:10.101685 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f2d574cb-4ade-4252-878e-b617a3444224 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:10.102184 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f2d574cb-4ade-4252-878e-b617a3444224 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:10.227960 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f2d574cb-4ade-4252-878e-b617a3444224 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28236 microversion: 2.1 time: 0.141831 Feb 17 03:37:10.228604 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 580/1165] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:10 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28236 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:10.268924 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fd33fda9-1644-4dbd-8cd4-06175fba169c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:10.270129 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fd33fda9-1644-4dbd-8cd4-06175fba169c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:10.278750 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fd33fda9-1644-4dbd-8cd4-06175fba169c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:10.279258 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fd33fda9-1644-4dbd-8cd4-06175fba169c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:10.280094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fd33fda9-1644-4dbd-8cd4-06175fba169c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:10.280590 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fd33fda9-1644-4dbd-8cd4-06175fba169c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:10.400411 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fd33fda9-1644-4dbd-8cd4-06175fba169c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.135731 Feb 17 03:37:10.401141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 586/1166] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:10 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:11.241166 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e436dc57-7aac-4d55-9f05-8ec0a64b05d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:11.242234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e436dc57-7aac-4d55-9f05-8ec0a64b05d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:11.251162 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e436dc57-7aac-4d55-9f05-8ec0a64b05d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:11.251679 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e436dc57-7aac-4d55-9f05-8ec0a64b05d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:11.252531 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e436dc57-7aac-4d55-9f05-8ec0a64b05d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:11.253022 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e436dc57-7aac-4d55-9f05-8ec0a64b05d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:11.383893 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e436dc57-7aac-4d55-9f05-8ec0a64b05d2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28236 microversion: 2.1 time: 0.147037 Feb 17 03:37:11.384633 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 581/1167] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:11 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28236 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:37:11.414617 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4e6b53f6-2805-42b3-a521-b9cf12b1c7c2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:11.415808 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4e6b53f6-2805-42b3-a521-b9cf12b1c7c2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:11.424543 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4e6b53f6-2805-42b3-a521-b9cf12b1c7c2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:11.425061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4e6b53f6-2805-42b3-a521-b9cf12b1c7c2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:11.425929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4e6b53f6-2805-42b3-a521-b9cf12b1c7c2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:11.426421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4e6b53f6-2805-42b3-a521-b9cf12b1c7c2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:11.547574 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4e6b53f6-2805-42b3-a521-b9cf12b1c7c2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.137834 Feb 17 03:37:11.548227 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 587/1168] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:11 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:12.398090 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7f3f92d8-830c-40c9-8b5b-4680d3aa5972 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:12.399292 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7f3f92d8-830c-40c9-8b5b-4680d3aa5972 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:12.408651 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f3f92d8-830c-40c9-8b5b-4680d3aa5972 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:12.409188 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f3f92d8-830c-40c9-8b5b-4680d3aa5972 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:12.410045 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f3f92d8-830c-40c9-8b5b-4680d3aa5972 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:12.410535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f3f92d8-830c-40c9-8b5b-4680d3aa5972 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:12.535706 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7f3f92d8-830c-40c9-8b5b-4680d3aa5972 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28236 microversion: 2.1 time: 0.142672 Feb 17 03:37:12.536464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 582/1169] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:12 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28236 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:12.561069 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b11ce341-6d3f-46bd-8ac9-dc466824b305 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:12.562230 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b11ce341-6d3f-46bd-8ac9-dc466824b305 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:12.572254 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b11ce341-6d3f-46bd-8ac9-dc466824b305 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:12.572691 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b11ce341-6d3f-46bd-8ac9-dc466824b305 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:12.573593 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b11ce341-6d3f-46bd-8ac9-dc466824b305 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:12.574095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b11ce341-6d3f-46bd-8ac9-dc466824b305 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:12.705131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b11ce341-6d3f-46bd-8ac9-dc466824b305 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.148530 Feb 17 03:37:12.705902 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 588/1170] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:12 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:13.549099 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3d744cfb-3061-468e-9818-187d202301d6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:13.550324 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3d744cfb-3061-468e-9818-187d202301d6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:13.559051 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3d744cfb-3061-468e-9818-187d202301d6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:13.559559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3d744cfb-3061-468e-9818-187d202301d6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:13.560412 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3d744cfb-3061-468e-9818-187d202301d6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:13.560907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3d744cfb-3061-468e-9818-187d202301d6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:13.679177 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3d744cfb-3061-468e-9818-187d202301d6 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28236 microversion: 2.1 time: 0.134447 Feb 17 03:37:13.679895 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 583/1171] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:13 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28236 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:13.718464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cfdb24e6-222c-4485-b751-1ed82572bb75 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:13.719602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cfdb24e6-222c-4485-b751-1ed82572bb75 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:13.728841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cfdb24e6-222c-4485-b751-1ed82572bb75 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:13.729402 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cfdb24e6-222c-4485-b751-1ed82572bb75 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:13.730246 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cfdb24e6-222c-4485-b751-1ed82572bb75 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:13.730737 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cfdb24e6-222c-4485-b751-1ed82572bb75 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:13.850243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cfdb24e6-222c-4485-b751-1ed82572bb75 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.135975 Feb 17 03:37:13.851689 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 589/1172] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:13 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:14.692958 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-259bc353-3395-40e7-b299-03687e14f4e0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:14.694144 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-259bc353-3395-40e7-b299-03687e14f4e0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:14.703366 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-259bc353-3395-40e7-b299-03687e14f4e0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:14.703997 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-259bc353-3395-40e7-b299-03687e14f4e0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:14.705167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-259bc353-3395-40e7-b299-03687e14f4e0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:14.706207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-259bc353-3395-40e7-b299-03687e14f4e0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:14.834540 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-259bc353-3395-40e7-b299-03687e14f4e0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28236 microversion: 2.1 time: 0.146408 Feb 17 03:37:14.835250 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 584/1173] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:14 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28236 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:14.863699 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-53c86f71-4a48-4a12-80d7-ac595c2da7c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:14.865127 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-53c86f71-4a48-4a12-80d7-ac595c2da7c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:14.873830 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-53c86f71-4a48-4a12-80d7-ac595c2da7c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:14.874384 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-53c86f71-4a48-4a12-80d7-ac595c2da7c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:14.875233 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-53c86f71-4a48-4a12-80d7-ac595c2da7c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:14.875729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-53c86f71-4a48-4a12-80d7-ac595c2da7c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:14.999286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-53c86f71-4a48-4a12-80d7-ac595c2da7c6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.140401 Feb 17 03:37:14.999911 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 590/1174] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:14 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:15.848777 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-46910dc5-5a49-4aa3-bbc8-8787e9e0c4ee tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:15.849964 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-46910dc5-5a49-4aa3-bbc8-8787e9e0c4ee tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:15.859682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-46910dc5-5a49-4aa3-bbc8-8787e9e0c4ee tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:15.860198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-46910dc5-5a49-4aa3-bbc8-8787e9e0c4ee tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:15.861054 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-46910dc5-5a49-4aa3-bbc8-8787e9e0c4ee tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:15.861556 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-46910dc5-5a49-4aa3-bbc8-8787e9e0c4ee tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:15.987487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-46910dc5-5a49-4aa3-bbc8-8787e9e0c4ee tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28236 microversion: 2.1 time: 0.143547 Feb 17 03:37:15.988244 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 585/1175] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:15 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28236 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:16.012916 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-03f81efc-47e8-40ba-81ed-bcb3de7d1b30 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:16.014091 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-03f81efc-47e8-40ba-81ed-bcb3de7d1b30 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:16.023172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-03f81efc-47e8-40ba-81ed-bcb3de7d1b30 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:16.023678 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-03f81efc-47e8-40ba-81ed-bcb3de7d1b30 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:16.024523 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-03f81efc-47e8-40ba-81ed-bcb3de7d1b30 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:16.025015 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-03f81efc-47e8-40ba-81ed-bcb3de7d1b30 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:16.147679 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-03f81efc-47e8-40ba-81ed-bcb3de7d1b30 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 28634 microversion: 2.20 time: 0.139148 Feb 17 03:37:16.148416 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 591/1176] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:16 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 28634 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:17.000658 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2c757a5f-261a-492c-96d1-7f22317615ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:17.001836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2c757a5f-261a-492c-96d1-7f22317615ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:17.010406 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2c757a5f-261a-492c-96d1-7f22317615ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:17.010907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2c757a5f-261a-492c-96d1-7f22317615ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:17.011739 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2c757a5f-261a-492c-96d1-7f22317615ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:17.012223 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2c757a5f-261a-492c-96d1-7f22317615ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:17.143901 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2c757a5f-261a-492c-96d1-7f22317615ae tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28236 microversion: 2.1 time: 0.146963 Feb 17 03:37:17.144614 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 586/1177] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:16 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28236 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:17.161709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f5656b4e-b977-4d16-8a9c-5970bc0da7c7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:17.162837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f5656b4e-b977-4d16-8a9c-5970bc0da7c7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:17.171389 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f5656b4e-b977-4d16-8a9c-5970bc0da7c7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:17.171903 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f5656b4e-b977-4d16-8a9c-5970bc0da7c7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:17.172748 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f5656b4e-b977-4d16-8a9c-5970bc0da7c7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:17.173279 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f5656b4e-b977-4d16-8a9c-5970bc0da7c7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:17.340872 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f5656b4e-b977-4d16-8a9c-5970bc0da7c7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 30389 microversion: 2.20 time: 0.184224 Feb 17 03:37:17.341626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 592/1178] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:17 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 30389 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:18.157242 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-93fb1173-455f-4d7e-8d87-37f1c26da36a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:18.158308 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-93fb1173-455f-4d7e-8d87-37f1c26da36a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:18.167691 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-93fb1173-455f-4d7e-8d87-37f1c26da36a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:18.168199 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-93fb1173-455f-4d7e-8d87-37f1c26da36a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:18.169170 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-93fb1173-455f-4d7e-8d87-37f1c26da36a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:18.169661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-93fb1173-455f-4d7e-8d87-37f1c26da36a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:18.297382 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-93fb1173-455f-4d7e-8d87-37f1c26da36a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28236 microversion: 2.1 time: 0.144586 Feb 17 03:37:18.298370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 587/1179] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:18 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28236 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:18.354024 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0e6db565-9535-4fe9-8268-3a1eaff7632f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:18.355160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0e6db565-9535-4fe9-8268-3a1eaff7632f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:18.364138 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0e6db565-9535-4fe9-8268-3a1eaff7632f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:18.364648 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0e6db565-9535-4fe9-8268-3a1eaff7632f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:18.365520 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0e6db565-9535-4fe9-8268-3a1eaff7632f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:18.366017 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0e6db565-9535-4fe9-8268-3a1eaff7632f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:18.498700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0e6db565-9535-4fe9-8268-3a1eaff7632f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 32442 microversion: 2.20 time: 0.148928 Feb 17 03:37:18.499347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 593/1180] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:18 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 32442 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:19.310634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5d6a9b4a-953c-48a1-b389-3f14949fbed0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:19.311700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5d6a9b4a-953c-48a1-b389-3f14949fbed0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:19.320953 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5d6a9b4a-953c-48a1-b389-3f14949fbed0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:19.321744 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5d6a9b4a-953c-48a1-b389-3f14949fbed0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:19.322591 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5d6a9b4a-953c-48a1-b389-3f14949fbed0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:19.323081 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5d6a9b4a-953c-48a1-b389-3f14949fbed0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:19.488881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5d6a9b4a-953c-48a1-b389-3f14949fbed0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28236 microversion: 2.1 time: 0.182701 Feb 17 03:37:19.489662 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 588/1181] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:19 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28236 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:19.512461 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9574bd78-71f0-4337-9cc4-15f7bf5660be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:19.513650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9574bd78-71f0-4337-9cc4-15f7bf5660be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:19.522333 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9574bd78-71f0-4337-9cc4-15f7bf5660be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:19.522846 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9574bd78-71f0-4337-9cc4-15f7bf5660be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:19.523702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9574bd78-71f0-4337-9cc4-15f7bf5660be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:19.524247 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9574bd78-71f0-4337-9cc4-15f7bf5660be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:19.666152 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9574bd78-71f0-4337-9cc4-15f7bf5660be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 33478 microversion: 2.20 time: 0.158075 Feb 17 03:37:19.670451 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 594/1182] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:19 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 33478 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:20.502434 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-059661d3-4442-4b01-8d37-829c1ec30a56 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:20.503569 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-059661d3-4442-4b01-8d37-829c1ec30a56 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:20.512124 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-059661d3-4442-4b01-8d37-829c1ec30a56 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:20.512625 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-059661d3-4442-4b01-8d37-829c1ec30a56 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:20.513479 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-059661d3-4442-4b01-8d37-829c1ec30a56 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:20.513967 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-059661d3-4442-4b01-8d37-829c1ec30a56 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:20.639626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-059661d3-4442-4b01-8d37-829c1ec30a56 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28236 microversion: 2.1 time: 0.141774 Feb 17 03:37:20.640329 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 589/1183] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:20 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28236 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:20.679195 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2bc2f585-2f44-4737-92c6-876c1550f133 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:20.680329 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2bc2f585-2f44-4737-92c6-876c1550f133 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:20.688866 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2bc2f585-2f44-4737-92c6-876c1550f133 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:20.689407 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2bc2f585-2f44-4737-92c6-876c1550f133 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:20.690738 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2bc2f585-2f44-4737-92c6-876c1550f133 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:20.691226 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2bc2f585-2f44-4737-92c6-876c1550f133 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:20.835229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2bc2f585-2f44-4737-92c6-876c1550f133 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 34812 microversion: 2.20 time: 0.160168 Feb 17 03:37:20.835868 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 595/1184] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:20 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 34812 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:21.653723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-43ed93c5-f24f-4170-b804-282bf08f53e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:21.654862 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-43ed93c5-f24f-4170-b804-282bf08f53e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:21.664051 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43ed93c5-f24f-4170-b804-282bf08f53e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:21.664553 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43ed93c5-f24f-4170-b804-282bf08f53e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:21.665450 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43ed93c5-f24f-4170-b804-282bf08f53e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:21.665938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43ed93c5-f24f-4170-b804-282bf08f53e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:21.795869 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-43ed93c5-f24f-4170-b804-282bf08f53e4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28236 microversion: 2.1 time: 0.146413 Feb 17 03:37:21.796626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 590/1185] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:21 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28236 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:21.849901 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0f7f6ac1-cd7d-4db5-99c6-7c9c477a0aed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:21.851115 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0f7f6ac1-cd7d-4db5-99c6-7c9c477a0aed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:21.860332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0f7f6ac1-cd7d-4db5-99c6-7c9c477a0aed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:21.860837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0f7f6ac1-cd7d-4db5-99c6-7c9c477a0aed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:21.861750 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0f7f6ac1-cd7d-4db5-99c6-7c9c477a0aed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:21.862249 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0f7f6ac1-cd7d-4db5-99c6-7c9c477a0aed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:22.006058 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0f7f6ac1-cd7d-4db5-99c6-7c9c477a0aed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 36045 microversion: 2.20 time: 0.161254 Feb 17 03:37:22.006702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 596/1186] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:21 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 36045 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:22.809279 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f812c1fb-6dff-40c0-9337-e4c24b8ca14f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:22.810601 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f812c1fb-6dff-40c0-9337-e4c24b8ca14f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:22.819208 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f812c1fb-6dff-40c0-9337-e4c24b8ca14f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:22.819719 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f812c1fb-6dff-40c0-9337-e4c24b8ca14f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:22.820607 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f812c1fb-6dff-40c0-9337-e4c24b8ca14f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:22.821126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f812c1fb-6dff-40c0-9337-e4c24b8ca14f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:22.945702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f812c1fb-6dff-40c0-9337-e4c24b8ca14f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28236 microversion: 2.1 time: 0.140754 Feb 17 03:37:22.946676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 591/1187] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:22 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28236 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:23.019373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0c491fe7-fac0-426b-9eed-6322ebb5475c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:23.020523 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0c491fe7-fac0-426b-9eed-6322ebb5475c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:23.029212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c491fe7-fac0-426b-9eed-6322ebb5475c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:23.029728 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c491fe7-fac0-426b-9eed-6322ebb5475c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:23.030579 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c491fe7-fac0-426b-9eed-6322ebb5475c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:23.031093 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c491fe7-fac0-426b-9eed-6322ebb5475c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:23.172432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0c491fe7-fac0-426b-9eed-6322ebb5475c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 37819 microversion: 2.20 time: 0.157410 Feb 17 03:37:23.173168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 597/1188] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:23 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 37819 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:23.959414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fdeaa239-c35d-4a2e-846e-87681a421070 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:23.960608 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fdeaa239-c35d-4a2e-846e-87681a421070 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:23.969290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fdeaa239-c35d-4a2e-846e-87681a421070 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:23.969798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fdeaa239-c35d-4a2e-846e-87681a421070 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:23.970636 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fdeaa239-c35d-4a2e-846e-87681a421070 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:23.971150 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fdeaa239-c35d-4a2e-846e-87681a421070 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:24.106094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fdeaa239-c35d-4a2e-846e-87681a421070 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28527 microversion: 2.1 time: 0.151220 Feb 17 03:37:24.106739 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 592/1189] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:23 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28527 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:24.186612 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7f85d256-b5d0-426c-8e7a-bc32bdd1dff7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:24.187803 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7f85d256-b5d0-426c-8e7a-bc32bdd1dff7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:24.197306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f85d256-b5d0-426c-8e7a-bc32bdd1dff7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:24.197805 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f85d256-b5d0-426c-8e7a-bc32bdd1dff7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:24.198644 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f85d256-b5d0-426c-8e7a-bc32bdd1dff7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:24.199160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f85d256-b5d0-426c-8e7a-bc32bdd1dff7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:24.325501 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7f85d256-b5d0-426c-8e7a-bc32bdd1dff7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 38192 microversion: 2.20 time: 0.143405 Feb 17 03:37:24.326452 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 598/1190] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:24 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 38192 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:25.119504 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-63903137-1a52-4cc0-9422-7d789a498af1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:25.120656 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-63903137-1a52-4cc0-9422-7d789a498af1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:25.129893 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-63903137-1a52-4cc0-9422-7d789a498af1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:25.130404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-63903137-1a52-4cc0-9422-7d789a498af1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:25.131251 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-63903137-1a52-4cc0-9422-7d789a498af1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:25.131746 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-63903137-1a52-4cc0-9422-7d789a498af1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:25.257210 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-63903137-1a52-4cc0-9422-7d789a498af1 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28527 microversion: 2.1 time: 0.142045 Feb 17 03:37:25.257954 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 593/1191] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:25 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28527 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:25.339043 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7834bebe-f4f7-4f86-987d-03bbf0a6a088 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:25.340278 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7834bebe-f4f7-4f86-987d-03bbf0a6a088 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:25.349062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7834bebe-f4f7-4f86-987d-03bbf0a6a088 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:25.349569 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7834bebe-f4f7-4f86-987d-03bbf0a6a088 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:25.350430 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7834bebe-f4f7-4f86-987d-03bbf0a6a088 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:25.350923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7834bebe-f4f7-4f86-987d-03bbf0a6a088 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:25.476090 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7834bebe-f4f7-4f86-987d-03bbf0a6a088 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 38192 microversion: 2.20 time: 0.141372 Feb 17 03:37:25.477115 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 599/1192] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:25 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 38192 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:26.271142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-56011305-6738-489e-ad04-bbb3bcd1c3b5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:26.272282 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-56011305-6738-489e-ad04-bbb3bcd1c3b5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:26.281453 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-56011305-6738-489e-ad04-bbb3bcd1c3b5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:26.282001 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-56011305-6738-489e-ad04-bbb3bcd1c3b5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:26.282933 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-56011305-6738-489e-ad04-bbb3bcd1c3b5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:26.283432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-56011305-6738-489e-ad04-bbb3bcd1c3b5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:26.418848 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-56011305-6738-489e-ad04-bbb3bcd1c3b5 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.152227 Feb 17 03:37:26.419643 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 594/1193] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:26 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:26.489850 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-18225b5a-17a3-40d7-a3de-feb630190ebb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:26.491062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-18225b5a-17a3-40d7-a3de-feb630190ebb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:26.500184 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-18225b5a-17a3-40d7-a3de-feb630190ebb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:26.500697 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-18225b5a-17a3-40d7-a3de-feb630190ebb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:26.501594 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-18225b5a-17a3-40d7-a3de-feb630190ebb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:26.502095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-18225b5a-17a3-40d7-a3de-feb630190ebb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:26.633912 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-18225b5a-17a3-40d7-a3de-feb630190ebb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 38192 microversion: 2.20 time: 0.148464 Feb 17 03:37:26.634659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 600/1194] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:26 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 38192 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:27.432607 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-be4c5868-d1d5-40e3-a200-9b8f333a2246 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:27.433844 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-be4c5868-d1d5-40e3-a200-9b8f333a2246 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:27.444632 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be4c5868-d1d5-40e3-a200-9b8f333a2246 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:27.445168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be4c5868-d1d5-40e3-a200-9b8f333a2246 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:27.446031 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be4c5868-d1d5-40e3-a200-9b8f333a2246 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:27.446788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be4c5868-d1d5-40e3-a200-9b8f333a2246 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:27.573793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-be4c5868-d1d5-40e3-a200-9b8f333a2246 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.145389 Feb 17 03:37:27.574978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 595/1195] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:27 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:27.647512 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1ac98514-a4b3-4c8a-9335-f9d493e2062a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:27.648808 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1ac98514-a4b3-4c8a-9335-f9d493e2062a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:27.657309 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1ac98514-a4b3-4c8a-9335-f9d493e2062a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:27.657820 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1ac98514-a4b3-4c8a-9335-f9d493e2062a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:27.659282 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1ac98514-a4b3-4c8a-9335-f9d493e2062a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:27.659778 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1ac98514-a4b3-4c8a-9335-f9d493e2062a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:27.810690 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1ac98514-a4b3-4c8a-9335-f9d493e2062a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 38210 microversion: 2.20 time: 0.167942 Feb 17 03:37:27.811923 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 601/1196] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:27 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 38210 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:28.586580 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-891dd1d9-d888-490b-8ff6-3b77993dddee tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:28.587659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-891dd1d9-d888-490b-8ff6-3b77993dddee tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:28.596551 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-891dd1d9-d888-490b-8ff6-3b77993dddee tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:28.597080 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-891dd1d9-d888-490b-8ff6-3b77993dddee tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:28.597943 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-891dd1d9-d888-490b-8ff6-3b77993dddee tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:28.598733 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-891dd1d9-d888-490b-8ff6-3b77993dddee tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:28.737867 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-891dd1d9-d888-490b-8ff6-3b77993dddee tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.155727 Feb 17 03:37:28.738594 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 596/1197] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:28 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:28.825448 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c4fe2af3-74eb-4aa5-9f09-ec9202d907f9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:28.826627 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c4fe2af3-74eb-4aa5-9f09-ec9202d907f9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:28.835589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c4fe2af3-74eb-4aa5-9f09-ec9202d907f9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:28.836113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c4fe2af3-74eb-4aa5-9f09-ec9202d907f9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:28.837053 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c4fe2af3-74eb-4aa5-9f09-ec9202d907f9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:28.837500 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c4fe2af3-74eb-4aa5-9f09-ec9202d907f9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:28.989187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c4fe2af3-74eb-4aa5-9f09-ec9202d907f9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 200 len: 38335 microversion: 2.20 time: 0.168473 Feb 17 03:37:28.989919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 602/1198] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:28 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 38335 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:29.001272 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-50c89d15-220b-4190-9c91-862849e4c055 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:29.001935 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-50c89d15-220b-4190-9c91-862849e4c055 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:29.010959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-50c89d15-220b-4190-9c91-862849e4c055 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:29.011473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-50c89d15-220b-4190-9c91-862849e4c055 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:29.012345 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-50c89d15-220b-4190-9c91-862849e4c055 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:29.012838 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-50c89d15-220b-4190-9c91-862849e4c055 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:29.075826 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-50c89d15-220b-4190-9c91-862849e4c055 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/ips" status: 200 len: 151 microversion: 2.20 time: 0.079077 Feb 17 03:37:29.076473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 597/1199] 10.222.0.57 () {60 vars in 1279 bytes} [Wed Feb 17 03:37:28 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/ips => generated 151 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:29.751101 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-37e1f7d3-51ec-4408-aa41-264d1f7eadaf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:29.752729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-37e1f7d3-51ec-4408-aa41-264d1f7eadaf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:29.761225 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-37e1f7d3-51ec-4408-aa41-264d1f7eadaf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:29.761732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-37e1f7d3-51ec-4408-aa41-264d1f7eadaf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:29.762564 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-37e1f7d3-51ec-4408-aa41-264d1f7eadaf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:29.763051 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-37e1f7d3-51ec-4408-aa41-264d1f7eadaf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:29.910662 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-37e1f7d3-51ec-4408-aa41-264d1f7eadaf tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.163764 Feb 17 03:37:29.911396 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 603/1200] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:29 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:30.923491 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ba2676b4-ae79-47f5-9cbc-a1361f6bc2b8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:30.924576 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ba2676b4-ae79-47f5-9cbc-a1361f6bc2b8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:30.932919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ba2676b4-ae79-47f5-9cbc-a1361f6bc2b8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:30.933443 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ba2676b4-ae79-47f5-9cbc-a1361f6bc2b8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:30.934284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ba2676b4-ae79-47f5-9cbc-a1361f6bc2b8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:30.934773 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ba2676b4-ae79-47f5-9cbc-a1361f6bc2b8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:31.070932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ba2676b4-ae79-47f5-9cbc-a1361f6bc2b8 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.151249 Feb 17 03:37:31.071963 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 598/1201] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:30 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:31.632853 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ca1b75a1-91bc-40c7-9172-533cf6041b16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:31.633556 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ca1b75a1-91bc-40c7-9172-533cf6041b16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:31.642156 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca1b75a1-91bc-40c7-9172-533cf6041b16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:31.643156 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca1b75a1-91bc-40c7-9172-533cf6041b16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:31.643980 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca1b75a1-91bc-40c7-9172-533cf6041b16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:31.644466 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca1b75a1-91bc-40c7-9172-533cf6041b16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:31.704061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-ca1b75a1-91bc-40c7-9172-533cf6041b16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lazy-loading 'flavor' on Instance uuid eb13b0aa-8bce-4878-943d-e3483a430b36 {{(pid=98104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:37:32.084361 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ca4e319f-ae60-4340-bc55-8843117fb116 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:32.085707 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ca4e319f-ae60-4340-bc55-8843117fb116 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:32.094349 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca4e319f-ae60-4340-bc55-8843117fb116 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:32.094863 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca4e319f-ae60-4340-bc55-8843117fb116 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:32.095804 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca4e319f-ae60-4340-bc55-8843117fb116 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:32.096302 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca4e319f-ae60-4340-bc55-8843117fb116 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:32.099731 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ca1b75a1-91bc-40c7-9172-533cf6041b16 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 202 len: 0 microversion: 2.20 time: 0.471275 Feb 17 03:37:32.103646 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 604/1202] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:37:31 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:37:32.110098 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-46ade994-920c-4649-9610-11dc428eca9a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:32.110863 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-46ade994-920c-4649-9610-11dc428eca9a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:32.119974 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-46ade994-920c-4649-9610-11dc428eca9a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:32.120511 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-46ade994-920c-4649-9610-11dc428eca9a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:32.121400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-46ade994-920c-4649-9610-11dc428eca9a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:32.121892 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-46ade994-920c-4649-9610-11dc428eca9a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:32.304000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ca4e319f-ae60-4340-bc55-8843117fb116 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.224628 Feb 17 03:37:32.304704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 599/1203] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:32 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:37:32.347158 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-46ade994-920c-4649-9610-11dc428eca9a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:32.356556 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-46ade994-920c-4649-9610-11dc428eca9a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:32.358214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-46ade994-920c-4649-9610-11dc428eca9a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:32.359408 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-46ade994-920c-4649-9610-11dc428eca9a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1723 microversion: 2.20 time: 0.254110 Feb 17 03:37:32.360006 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 605/1204] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:32 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:37:33.317692 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d8bcd412-668d-40cf-a535-f6f3d5983644 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:33.318778 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d8bcd412-668d-40cf-a535-f6f3d5983644 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:33.327669 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d8bcd412-668d-40cf-a535-f6f3d5983644 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:33.328182 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d8bcd412-668d-40cf-a535-f6f3d5983644 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:33.329098 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d8bcd412-668d-40cf-a535-f6f3d5983644 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:33.329603 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d8bcd412-668d-40cf-a535-f6f3d5983644 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:33.380326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5b96a447-7d4b-4b72-a0ad-a492af264794 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:33.380990 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5b96a447-7d4b-4b72-a0ad-a492af264794 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:33.390124 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5b96a447-7d4b-4b72-a0ad-a492af264794 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:33.390627 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5b96a447-7d4b-4b72-a0ad-a492af264794 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:33.391473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5b96a447-7d4b-4b72-a0ad-a492af264794 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:33.391962 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5b96a447-7d4b-4b72-a0ad-a492af264794 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:33.460263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d8bcd412-668d-40cf-a535-f6f3d5983644 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.147496 Feb 17 03:37:33.461244 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 600/1205] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:33 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:33.602793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5b96a447-7d4b-4b72-a0ad-a492af264794 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:33.612253 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5b96a447-7d4b-4b72-a0ad-a492af264794 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:33.613883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5b96a447-7d4b-4b72-a0ad-a492af264794 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:33.615062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5b96a447-7d4b-4b72-a0ad-a492af264794 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1723 microversion: 2.20 time: 0.239409 Feb 17 03:37:33.615650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 606/1206] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:33 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:37:34.430982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-73e2c920-8e8f-428e-b8c9-3088f25e5506 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:34.432163 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-73e2c920-8e8f-428e-b8c9-3088f25e5506 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:34.440864 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73e2c920-8e8f-428e-b8c9-3088f25e5506 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:34.441435 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73e2c920-8e8f-428e-b8c9-3088f25e5506 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:34.442287 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73e2c920-8e8f-428e-b8c9-3088f25e5506 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:34.442775 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-73e2c920-8e8f-428e-b8c9-3088f25e5506 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:34.473618 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-103f22fe-5e42-4913-8200-2ba946e10938 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:34.474503 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-103f22fe-5e42-4913-8200-2ba946e10938 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:34.482281 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-103f22fe-5e42-4913-8200-2ba946e10938 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:34.482790 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-103f22fe-5e42-4913-8200-2ba946e10938 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:34.483626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-103f22fe-5e42-4913-8200-2ba946e10938 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:34.484117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-103f22fe-5e42-4913-8200-2ba946e10938 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:34.594812 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-73e2c920-8e8f-428e-b8c9-3088f25e5506 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "POST /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/action" status: 202 len: 0 microversion: 2.1 time: 0.168053 Feb 17 03:37:34.595428 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 601/1207] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:34 2021] POST /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:37:34.604998 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-99fd9d0f-da62-458c-9534-c532ddc5eede tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:34.605793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-99fd9d0f-da62-458c-9534-c532ddc5eede tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:34.615372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-103f22fe-5e42-4913-8200-2ba946e10938 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.145963 Feb 17 03:37:34.617375 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 607/1208] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:34 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:34.618257 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-99fd9d0f-da62-458c-9534-c532ddc5eede tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:34.619068 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-99fd9d0f-da62-458c-9534-c532ddc5eede tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:34.620528 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-99fd9d0f-da62-458c-9534-c532ddc5eede tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:34.621427 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-99fd9d0f-da62-458c-9534-c532ddc5eede tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:34.635508 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c7a3fac0-9d0c-45e3-a62e-8e324eb73de6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:34.636267 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c7a3fac0-9d0c-45e3-a62e-8e324eb73de6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:34.645298 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c7a3fac0-9d0c-45e3-a62e-8e324eb73de6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:34.645805 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c7a3fac0-9d0c-45e3-a62e-8e324eb73de6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:34.646635 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c7a3fac0-9d0c-45e3-a62e-8e324eb73de6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:34.647122 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c7a3fac0-9d0c-45e3-a62e-8e324eb73de6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:35.165573 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-99fd9d0f-da62-458c-9534-c532ddc5eede tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:35.175892 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-99fd9d0f-da62-458c-9534-c532ddc5eede tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1761 microversion: 2.1 time: 0.575149 Feb 17 03:37:35.176502 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 602/1209] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:34 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1761 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:37:35.204485 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c7a3fac0-9d0c-45e3-a62e-8e324eb73de6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:35.214044 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c7a3fac0-9d0c-45e3-a62e-8e324eb73de6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:35.215615 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c7a3fac0-9d0c-45e3-a62e-8e324eb73de6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:35.216786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c7a3fac0-9d0c-45e3-a62e-8e324eb73de6 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1723 microversion: 2.20 time: 0.585888 Feb 17 03:37:35.217562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 608/1210] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:34 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1723 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:37:35.631207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b3785b34-836f-44c9-8474-49315023fa26 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:35.632339 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b3785b34-836f-44c9-8474-49315023fa26 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:35.641662 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b3785b34-836f-44c9-8474-49315023fa26 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:35.642164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b3785b34-836f-44c9-8474-49315023fa26 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:35.643011 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b3785b34-836f-44c9-8474-49315023fa26 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:35.643502 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b3785b34-836f-44c9-8474-49315023fa26 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:35.775090 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b3785b34-836f-44c9-8474-49315023fa26 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.147713 Feb 17 03:37:35.775975 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 603/1211] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:35 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:36.195613 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cdf98cdb-6d3a-4c2b-96b3-dff67b3090ee tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:36.196280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cdf98cdb-6d3a-4c2b-96b3-dff67b3090ee tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:36.206191 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cdf98cdb-6d3a-4c2b-96b3-dff67b3090ee tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:36.206699 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cdf98cdb-6d3a-4c2b-96b3-dff67b3090ee tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:36.207534 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cdf98cdb-6d3a-4c2b-96b3-dff67b3090ee tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:36.208031 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cdf98cdb-6d3a-4c2b-96b3-dff67b3090ee tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:36.237119 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0330fed0-8cab-45a1-b255-133b4c1f0303 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:36.237906 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0330fed0-8cab-45a1-b255-133b4c1f0303 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:36.246846 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0330fed0-8cab-45a1-b255-133b4c1f0303 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:36.247358 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0330fed0-8cab-45a1-b255-133b4c1f0303 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:36.248218 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0330fed0-8cab-45a1-b255-133b4c1f0303 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:36.248718 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0330fed0-8cab-45a1-b255-133b4c1f0303 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:36.422947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-cdf98cdb-6d3a-4c2b-96b3-dff67b3090ee tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:36.432669 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cdf98cdb-6d3a-4c2b-96b3-dff67b3090ee tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1766 microversion: 2.1 time: 0.241061 Feb 17 03:37:36.433300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 609/1212] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:36 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1766 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:36.468261 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0330fed0-8cab-45a1-b255-133b4c1f0303 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:36.477567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0330fed0-8cab-45a1-b255-133b4c1f0303 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:36.479187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0330fed0-8cab-45a1-b255-133b4c1f0303 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:36.480375 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0330fed0-8cab-45a1-b255-133b4c1f0303 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1723 microversion: 2.20 time: 0.247896 Feb 17 03:37:36.480963 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 604/1213] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:36 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:37:36.787870 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6854cd0b-5512-4a86-9138-fa30a6df001a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:36.788843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6854cd0b-5512-4a86-9138-fa30a6df001a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:36.796684 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6854cd0b-5512-4a86-9138-fa30a6df001a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:36.797227 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6854cd0b-5512-4a86-9138-fa30a6df001a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:36.798068 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6854cd0b-5512-4a86-9138-fa30a6df001a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:36.798563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6854cd0b-5512-4a86-9138-fa30a6df001a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:36.939415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6854cd0b-5512-4a86-9138-fa30a6df001a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.155843 Feb 17 03:37:36.940119 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 610/1214] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:36 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:37.452062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8fce358e-630d-4639-b320-fae60d588cf9 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:37.452728 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8fce358e-630d-4639-b320-fae60d588cf9 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:37.461693 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8fce358e-630d-4639-b320-fae60d588cf9 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:37.462199 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8fce358e-630d-4639-b320-fae60d588cf9 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:37.463037 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8fce358e-630d-4639-b320-fae60d588cf9 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:37.463516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8fce358e-630d-4639-b320-fae60d588cf9 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:37.501205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4b95309b-5b48-40b6-a085-5e3b4d17e8eb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:37.502670 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4b95309b-5b48-40b6-a085-5e3b4d17e8eb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:37.511260 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4b95309b-5b48-40b6-a085-5e3b4d17e8eb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:37.511777 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4b95309b-5b48-40b6-a085-5e3b4d17e8eb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:37.512619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4b95309b-5b48-40b6-a085-5e3b4d17e8eb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:37.513132 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4b95309b-5b48-40b6-a085-5e3b4d17e8eb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:37.679588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8fce358e-630d-4639-b320-fae60d588cf9 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:37.689102 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8fce358e-630d-4639-b320-fae60d588cf9 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1766 microversion: 2.1 time: 0.241036 Feb 17 03:37:37.690276 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 605/1215] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:37 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1766 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:37.726760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4b95309b-5b48-40b6-a085-5e3b4d17e8eb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:37.736987 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4b95309b-5b48-40b6-a085-5e3b4d17e8eb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:37.738725 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4b95309b-5b48-40b6-a085-5e3b4d17e8eb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:37.739922 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4b95309b-5b48-40b6-a085-5e3b4d17e8eb tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1723 microversion: 2.20 time: 0.243634 Feb 17 03:37:37.740527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 611/1216] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:37 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:37:37.952256 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7dd98cf5-fd05-4637-96ca-eb201486aca4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:37.953371 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7dd98cf5-fd05-4637-96ca-eb201486aca4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:37.961268 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7dd98cf5-fd05-4637-96ca-eb201486aca4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:37.961785 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7dd98cf5-fd05-4637-96ca-eb201486aca4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:37.962633 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7dd98cf5-fd05-4637-96ca-eb201486aca4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:37.963122 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7dd98cf5-fd05-4637-96ca-eb201486aca4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:38.090736 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7dd98cf5-fd05-4637-96ca-eb201486aca4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.142255 Feb 17 03:37:38.091611 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 606/1217] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:37 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:38.708976 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a2fb4e3b-6232-4a4d-b6ce-1526788ed39c tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:38.709679 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a2fb4e3b-6232-4a4d-b6ce-1526788ed39c tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:38.718603 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a2fb4e3b-6232-4a4d-b6ce-1526788ed39c tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:38.719114 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a2fb4e3b-6232-4a4d-b6ce-1526788ed39c tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:38.719959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a2fb4e3b-6232-4a4d-b6ce-1526788ed39c tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:38.720461 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a2fb4e3b-6232-4a4d-b6ce-1526788ed39c tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:38.759719 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6536e3c2-a648-4623-a532-7988a085f67a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:38.760493 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6536e3c2-a648-4623-a532-7988a085f67a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:38.769732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6536e3c2-a648-4623-a532-7988a085f67a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:38.770249 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6536e3c2-a648-4623-a532-7988a085f67a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:38.771092 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6536e3c2-a648-4623-a532-7988a085f67a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:38.771587 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6536e3c2-a648-4623-a532-7988a085f67a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:38.938860 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a2fb4e3b-6232-4a4d-b6ce-1526788ed39c tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:38.949478 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a2fb4e3b-6232-4a4d-b6ce-1526788ed39c tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1766 microversion: 2.1 time: 0.245010 Feb 17 03:37:38.950097 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 612/1218] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:38 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1766 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:39.007620 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6536e3c2-a648-4623-a532-7988a085f67a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:39.016960 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6536e3c2-a648-4623-a532-7988a085f67a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:39.018605 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6536e3c2-a648-4623-a532-7988a085f67a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:39.019797 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6536e3c2-a648-4623-a532-7988a085f67a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1723 microversion: 2.20 time: 0.264646 Feb 17 03:37:39.020382 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 607/1219] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:38 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:37:39.103234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-798bf7f8-4270-4d28-bb63-e17987927657 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:39.104287 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-798bf7f8-4270-4d28-bb63-e17987927657 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:39.112668 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-798bf7f8-4270-4d28-bb63-e17987927657 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:39.113212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-798bf7f8-4270-4d28-bb63-e17987927657 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:39.114054 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-798bf7f8-4270-4d28-bb63-e17987927657 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:39.114546 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-798bf7f8-4270-4d28-bb63-e17987927657 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:39.242687 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-798bf7f8-4270-4d28-bb63-e17987927657 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.143167 Feb 17 03:37:39.243404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 613/1220] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:39 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:39.968195 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-01157132-c59f-4866-902e-74b52c696d89 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:39.968866 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-01157132-c59f-4866-902e-74b52c696d89 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:40.040604 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f5195f88-075c-4d4f-ad9f-fd40aeef521b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:40.041470 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f5195f88-075c-4d4f-ad9f-fd40aeef521b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:40.050991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f5195f88-075c-4d4f-ad9f-fd40aeef521b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:40.051504 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f5195f88-075c-4d4f-ad9f-fd40aeef521b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:40.052441 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f5195f88-075c-4d4f-ad9f-fd40aeef521b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:40.052939 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f5195f88-075c-4d4f-ad9f-fd40aeef521b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:40.118369 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-01157132-c59f-4866-902e-74b52c696d89 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:40.118900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-01157132-c59f-4866-902e-74b52c696d89 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:40.119804 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-01157132-c59f-4866-902e-74b52c696d89 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:40.120321 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-01157132-c59f-4866-902e-74b52c696d89 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:40.283121 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f5195f88-075c-4d4f-ad9f-fd40aeef521b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:40.293275 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f5195f88-075c-4d4f-ad9f-fd40aeef521b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:40.294876 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f5195f88-075c-4d4f-ad9f-fd40aeef521b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:40.296258 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f5195f88-075c-4d4f-ad9f-fd40aeef521b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1723 microversion: 2.20 time: 0.260659 Feb 17 03:37:40.296849 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 614/1221] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:40 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:37:40.301907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b5d92760-7f2d-4dbc-96e3-c3c5fd98c54a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:40.302969 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b5d92760-7f2d-4dbc-96e3-c3c5fd98c54a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:40.311276 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b5d92760-7f2d-4dbc-96e3-c3c5fd98c54a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:40.311772 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b5d92760-7f2d-4dbc-96e3-c3c5fd98c54a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:40.312631 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b5d92760-7f2d-4dbc-96e3-c3c5fd98c54a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:40.313153 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b5d92760-7f2d-4dbc-96e3-c3c5fd98c54a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:40.349771 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-01157132-c59f-4866-902e-74b52c696d89 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:40.359777 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-01157132-c59f-4866-902e-74b52c696d89 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1766 microversion: 2.1 time: 0.395606 Feb 17 03:37:40.360404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 608/1222] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:39 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1766 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:40.446074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b5d92760-7f2d-4dbc-96e3-c3c5fd98c54a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.147754 Feb 17 03:37:40.447054 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 615/1223] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:40 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:41.316723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-933f0bec-734e-466c-9863-17bb55907ee1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:41.317325 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-933f0bec-734e-466c-9863-17bb55907ee1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:41.325334 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-933f0bec-734e-466c-9863-17bb55907ee1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:41.325841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-933f0bec-734e-466c-9863-17bb55907ee1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:41.326676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-933f0bec-734e-466c-9863-17bb55907ee1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:41.327164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-933f0bec-734e-466c-9863-17bb55907ee1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:41.379856 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4393f472-da26-45d6-bef4-fcdfe65a7039 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:41.380676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4393f472-da26-45d6-bef4-fcdfe65a7039 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:41.389410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4393f472-da26-45d6-bef4-fcdfe65a7039 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:41.389954 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4393f472-da26-45d6-bef4-fcdfe65a7039 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:41.390843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4393f472-da26-45d6-bef4-fcdfe65a7039 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:41.391391 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4393f472-da26-45d6-bef4-fcdfe65a7039 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:41.541546 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-933f0bec-734e-466c-9863-17bb55907ee1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:41.552400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-933f0bec-734e-466c-9863-17bb55907ee1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:41.554168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-933f0bec-734e-466c-9863-17bb55907ee1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:41.555510 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-933f0bec-734e-466c-9863-17bb55907ee1 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1723 microversion: 2.20 time: 0.243599 Feb 17 03:37:41.556389 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 609/1224] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:41 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:37:41.561168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-39c4814c-597c-4cf4-9240-21935436aa1e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:41.562387 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-39c4814c-597c-4cf4-9240-21935436aa1e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:41.570535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-39c4814c-597c-4cf4-9240-21935436aa1e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:41.570985 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-39c4814c-597c-4cf4-9240-21935436aa1e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:41.572091 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-39c4814c-597c-4cf4-9240-21935436aa1e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:41.572743 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-39c4814c-597c-4cf4-9240-21935436aa1e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:41.615163 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4393f472-da26-45d6-bef4-fcdfe65a7039 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:41.624550 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4393f472-da26-45d6-bef4-fcdfe65a7039 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1766 microversion: 2.1 time: 0.249973 Feb 17 03:37:41.625165 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 616/1225] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:41 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1766 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:37:41.695282 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-39c4814c-597c-4cf4-9240-21935436aa1e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.137576 Feb 17 03:37:41.695977 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 610/1226] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:41 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:42.574904 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7a1af941-3618-494a-9686-ab37eefe7255 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:42.575553 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7a1af941-3618-494a-9686-ab37eefe7255 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:42.584990 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7a1af941-3618-494a-9686-ab37eefe7255 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:42.585562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7a1af941-3618-494a-9686-ab37eefe7255 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:42.586400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7a1af941-3618-494a-9686-ab37eefe7255 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:42.586888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7a1af941-3618-494a-9686-ab37eefe7255 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:42.644619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-93c33f4b-916d-4fc6-a578-3c10a057f192 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:42.645429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-93c33f4b-916d-4fc6-a578-3c10a057f192 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:42.654104 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-93c33f4b-916d-4fc6-a578-3c10a057f192 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:42.654642 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-93c33f4b-916d-4fc6-a578-3c10a057f192 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:42.655552 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-93c33f4b-916d-4fc6-a578-3c10a057f192 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:42.656051 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-93c33f4b-916d-4fc6-a578-3c10a057f192 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:42.806644 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7a1af941-3618-494a-9686-ab37eefe7255 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:42.817121 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7a1af941-3618-494a-9686-ab37eefe7255 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:42.818725 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7a1af941-3618-494a-9686-ab37eefe7255 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:42.819937 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7a1af941-3618-494a-9686-ab37eefe7255 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1723 microversion: 2.20 time: 0.249577 Feb 17 03:37:42.820524 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 617/1227] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:42 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:37:42.825769 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c032fe7f-88ef-4fdf-82b7-a956c95483bd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:42.826797 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c032fe7f-88ef-4fdf-82b7-a956c95483bd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:42.834779 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c032fe7f-88ef-4fdf-82b7-a956c95483bd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:42.835282 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c032fe7f-88ef-4fdf-82b7-a956c95483bd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:42.836129 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c032fe7f-88ef-4fdf-82b7-a956c95483bd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:42.836616 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c032fe7f-88ef-4fdf-82b7-a956c95483bd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:42.881581 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-93c33f4b-916d-4fc6-a578-3c10a057f192 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:42.891684 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-93c33f4b-916d-4fc6-a578-3c10a057f192 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1766 microversion: 2.1 time: 0.252455 Feb 17 03:37:42.892418 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 611/1228] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:42 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1766 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:37:42.972501 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c032fe7f-88ef-4fdf-82b7-a956c95483bd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.150527 Feb 17 03:37:42.973238 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 618/1229] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:42 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:43.840180 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-267e65e2-0774-4fd4-88e6-3aea8aca67be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:43.840836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-267e65e2-0774-4fd4-88e6-3aea8aca67be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:43.849683 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-267e65e2-0774-4fd4-88e6-3aea8aca67be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:43.850200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-267e65e2-0774-4fd4-88e6-3aea8aca67be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:43.851049 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-267e65e2-0774-4fd4-88e6-3aea8aca67be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:43.851547 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-267e65e2-0774-4fd4-88e6-3aea8aca67be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:43.911158 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e1257bb9-17a9-4e1e-89a1-5e5f666b3838 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:43.911925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e1257bb9-17a9-4e1e-89a1-5e5f666b3838 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:43.920386 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e1257bb9-17a9-4e1e-89a1-5e5f666b3838 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:43.920896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e1257bb9-17a9-4e1e-89a1-5e5f666b3838 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:43.921754 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e1257bb9-17a9-4e1e-89a1-5e5f666b3838 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:43.922242 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e1257bb9-17a9-4e1e-89a1-5e5f666b3838 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:44.067862 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-267e65e2-0774-4fd4-88e6-3aea8aca67be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:44.077539 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-267e65e2-0774-4fd4-88e6-3aea8aca67be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:44.079234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-267e65e2-0774-4fd4-88e6-3aea8aca67be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:44.080439 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-267e65e2-0774-4fd4-88e6-3aea8aca67be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1723 microversion: 2.20 time: 0.244588 Feb 17 03:37:44.081008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 612/1230] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:43 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:37:44.085786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9d35af8c-bce4-49a7-b01e-e6898e7e9189 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:44.086804 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9d35af8c-bce4-49a7-b01e-e6898e7e9189 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:44.094492 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9d35af8c-bce4-49a7-b01e-e6898e7e9189 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:44.094932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9d35af8c-bce4-49a7-b01e-e6898e7e9189 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:44.096305 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9d35af8c-bce4-49a7-b01e-e6898e7e9189 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:44.096789 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9d35af8c-bce4-49a7-b01e-e6898e7e9189 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:44.143751 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e1257bb9-17a9-4e1e-89a1-5e5f666b3838 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:44.153314 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e1257bb9-17a9-4e1e-89a1-5e5f666b3838 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1766 microversion: 2.1 time: 0.247052 Feb 17 03:37:44.154094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 619/1231] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:43 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1766 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:44.221781 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9d35af8c-bce4-49a7-b01e-e6898e7e9189 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.138774 Feb 17 03:37:44.222503 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 613/1232] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:44 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:45.100012 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5a06e02e-b7eb-45c3-a7d1-bf899a63ac84 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:45.101280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5a06e02e-b7eb-45c3-a7d1-bf899a63ac84 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:45.109724 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a06e02e-b7eb-45c3-a7d1-bf899a63ac84 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:45.110227 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a06e02e-b7eb-45c3-a7d1-bf899a63ac84 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:45.111062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a06e02e-b7eb-45c3-a7d1-bf899a63ac84 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:45.111550 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a06e02e-b7eb-45c3-a7d1-bf899a63ac84 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:45.172768 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3332c6d4-6e11-43f4-b1f2-fb667304f0c1 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:45.173553 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3332c6d4-6e11-43f4-b1f2-fb667304f0c1 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:45.182303 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3332c6d4-6e11-43f4-b1f2-fb667304f0c1 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:45.182805 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3332c6d4-6e11-43f4-b1f2-fb667304f0c1 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:45.183640 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3332c6d4-6e11-43f4-b1f2-fb667304f0c1 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:45.184151 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-3332c6d4-6e11-43f4-b1f2-fb667304f0c1 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:45.329141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5a06e02e-b7eb-45c3-a7d1-bf899a63ac84 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:45.339032 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5a06e02e-b7eb-45c3-a7d1-bf899a63ac84 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:45.340625 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5a06e02e-b7eb-45c3-a7d1-bf899a63ac84 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:45.341830 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5a06e02e-b7eb-45c3-a7d1-bf899a63ac84 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1744 microversion: 2.20 time: 0.245966 Feb 17 03:37:45.342595 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 620/1233] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:45 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1744 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:37:45.347363 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d05e20ea-325c-40c5-94c5-7b4be2b63d71 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:45.348387 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d05e20ea-325c-40c5-94c5-7b4be2b63d71 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:45.356126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d05e20ea-325c-40c5-94c5-7b4be2b63d71 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:45.356627 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d05e20ea-325c-40c5-94c5-7b4be2b63d71 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:45.357520 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d05e20ea-325c-40c5-94c5-7b4be2b63d71 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:45.358191 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d05e20ea-325c-40c5-94c5-7b4be2b63d71 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:45.402325 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3332c6d4-6e11-43f4-b1f2-fb667304f0c1 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:45.411842 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3332c6d4-6e11-43f4-b1f2-fb667304f0c1 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1766 microversion: 2.1 time: 0.243622 Feb 17 03:37:45.412441 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 614/1234] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:45 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1766 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:37:45.483224 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d05e20ea-325c-40c5-94c5-7b4be2b63d71 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.139202 Feb 17 03:37:45.484083 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 621/1235] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:45 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:46.362556 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-09c14167-480c-406d-8348-f02ca406fe48 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:46.363210 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-09c14167-480c-406d-8348-f02ca406fe48 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:46.371602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09c14167-480c-406d-8348-f02ca406fe48 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:46.372099 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09c14167-480c-406d-8348-f02ca406fe48 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:46.372930 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09c14167-480c-406d-8348-f02ca406fe48 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:46.373440 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-09c14167-480c-406d-8348-f02ca406fe48 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:46.431151 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cc1c23ab-9c60-408d-8f4e-53116fe43d19 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:46.431933 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cc1c23ab-9c60-408d-8f4e-53116fe43d19 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:46.440653 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cc1c23ab-9c60-408d-8f4e-53116fe43d19 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:46.441214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cc1c23ab-9c60-408d-8f4e-53116fe43d19 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:46.442070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cc1c23ab-9c60-408d-8f4e-53116fe43d19 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:46.442569 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cc1c23ab-9c60-408d-8f4e-53116fe43d19 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:46.588377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-09c14167-480c-406d-8348-f02ca406fe48 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:46.598697 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-09c14167-480c-406d-8348-f02ca406fe48 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:46.600289 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-09c14167-480c-406d-8348-f02ca406fe48 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:46.601566 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-09c14167-480c-406d-8348-f02ca406fe48 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1744 microversion: 2.20 time: 0.243748 Feb 17 03:37:46.602142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 615/1236] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:46 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1744 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:37:46.606810 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-43ac2a0d-dc38-4d81-9e9a-a10369056939 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:46.607854 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-43ac2a0d-dc38-4d81-9e9a-a10369056939 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:46.615716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43ac2a0d-dc38-4d81-9e9a-a10369056939 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:46.616232 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43ac2a0d-dc38-4d81-9e9a-a10369056939 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:46.617128 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43ac2a0d-dc38-4d81-9e9a-a10369056939 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:46.617630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-43ac2a0d-dc38-4d81-9e9a-a10369056939 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:46.659978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-cc1c23ab-9c60-408d-8f4e-53116fe43d19 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:46.669598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cc1c23ab-9c60-408d-8f4e-53116fe43d19 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1766 microversion: 2.1 time: 0.243196 Feb 17 03:37:46.670201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 622/1237] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:46 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1766 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:37:46.767142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-43ac2a0d-dc38-4d81-9e9a-a10369056939 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.163657 Feb 17 03:37:46.768566 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 616/1238] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:46 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:47.620526 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b375f251-9eab-433a-b0ca-b5120229163e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:47.621220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b375f251-9eab-433a-b0ca-b5120229163e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:47.629559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b375f251-9eab-433a-b0ca-b5120229163e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:47.630072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b375f251-9eab-433a-b0ca-b5120229163e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:47.630914 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b375f251-9eab-433a-b0ca-b5120229163e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:47.631404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b375f251-9eab-433a-b0ca-b5120229163e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:47.689184 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-18d220be-af3c-4b79-92ca-797b91faefe3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:47.690106 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-18d220be-af3c-4b79-92ca-797b91faefe3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:47.699658 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-18d220be-af3c-4b79-92ca-797b91faefe3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:47.700280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-18d220be-af3c-4b79-92ca-797b91faefe3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:47.701276 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-18d220be-af3c-4b79-92ca-797b91faefe3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:47.701934 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-18d220be-af3c-4b79-92ca-797b91faefe3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:47.871050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b375f251-9eab-433a-b0ca-b5120229163e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:47.880952 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b375f251-9eab-433a-b0ca-b5120229163e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:47.882927 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b375f251-9eab-433a-b0ca-b5120229163e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:47.884335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b375f251-9eab-433a-b0ca-b5120229163e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1744 microversion: 2.20 time: 0.268049 Feb 17 03:37:47.885445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 623/1239] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:47 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1744 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:37:47.890567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ed352522-34e1-4054-ad7f-5ee9ed03113b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:47.892122 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ed352522-34e1-4054-ad7f-5ee9ed03113b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:47.902868 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ed352522-34e1-4054-ad7f-5ee9ed03113b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:47.903436 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ed352522-34e1-4054-ad7f-5ee9ed03113b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:47.906009 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ed352522-34e1-4054-ad7f-5ee9ed03113b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:47.906714 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ed352522-34e1-4054-ad7f-5ee9ed03113b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:47.949786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-18d220be-af3c-4b79-92ca-797b91faefe3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:47.959984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-18d220be-af3c-4b79-92ca-797b91faefe3 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1766 microversion: 2.1 time: 0.275428 Feb 17 03:37:47.960425 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 617/1240] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:47 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1766 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:48.035690 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ed352522-34e1-4054-ad7f-5ee9ed03113b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.148526 Feb 17 03:37:48.036413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 624/1241] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:47 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:48.978534 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0d6488ae-eee7-479b-b1f4-6e0e98ff6600 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:48.979400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0d6488ae-eee7-479b-b1f4-6e0e98ff6600 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:48.988114 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0d6488ae-eee7-479b-b1f4-6e0e98ff6600 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:48.988626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0d6488ae-eee7-479b-b1f4-6e0e98ff6600 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:48.989503 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0d6488ae-eee7-479b-b1f4-6e0e98ff6600 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:48.989999 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0d6488ae-eee7-479b-b1f4-6e0e98ff6600 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:49.000193 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-36b0bbba-1966-404f-9b53-4dfc3658a8c4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:49.001095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-36b0bbba-1966-404f-9b53-4dfc3658a8c4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:49.009130 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-36b0bbba-1966-404f-9b53-4dfc3658a8c4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:49.009715 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-36b0bbba-1966-404f-9b53-4dfc3658a8c4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:49.010572 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-36b0bbba-1966-404f-9b53-4dfc3658a8c4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:49.011060 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-36b0bbba-1966-404f-9b53-4dfc3658a8c4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:49.207795 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0d6488ae-eee7-479b-b1f4-6e0e98ff6600 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:49.217359 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0d6488ae-eee7-479b-b1f4-6e0e98ff6600 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1766 microversion: 2.1 time: 0.243122 Feb 17 03:37:49.217969 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 625/1242] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:48 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1766 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:37:49.222809 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-be8bb5c7-7a0d-4709-b54d-004f7dda8a2e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:49.223835 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-be8bb5c7-7a0d-4709-b54d-004f7dda8a2e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:49.226112 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-36b0bbba-1966-404f-9b53-4dfc3658a8c4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:49.231822 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be8bb5c7-7a0d-4709-b54d-004f7dda8a2e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:49.232323 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be8bb5c7-7a0d-4709-b54d-004f7dda8a2e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:49.233188 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be8bb5c7-7a0d-4709-b54d-004f7dda8a2e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:49.233682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be8bb5c7-7a0d-4709-b54d-004f7dda8a2e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:49.236340 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-36b0bbba-1966-404f-9b53-4dfc3658a8c4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:49.238050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-36b0bbba-1966-404f-9b53-4dfc3658a8c4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:49.239369 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-36b0bbba-1966-404f-9b53-4dfc3658a8c4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1744 microversion: 2.20 time: 0.339287 Feb 17 03:37:49.240037 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 618/1243] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:48 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1744 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:37:49.357157 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-be8bb5c7-7a0d-4709-b54d-004f7dda8a2e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.137806 Feb 17 03:37:49.357840 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 626/1244] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:49 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:50.236225 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0c1342e3-404b-410d-862e-e4d803e2f158 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:50.236826 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0c1342e3-404b-410d-862e-e4d803e2f158 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:50.244685 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c1342e3-404b-410d-862e-e4d803e2f158 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:50.245226 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c1342e3-404b-410d-862e-e4d803e2f158 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:50.246063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c1342e3-404b-410d-862e-e4d803e2f158 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:50.246555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0c1342e3-404b-410d-862e-e4d803e2f158 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:50.259995 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-701ba422-cc02-4efa-884d-99650662edae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:50.260898 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-701ba422-cc02-4efa-884d-99650662edae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:50.270070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-701ba422-cc02-4efa-884d-99650662edae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:50.270702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-701ba422-cc02-4efa-884d-99650662edae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:50.271543 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-701ba422-cc02-4efa-884d-99650662edae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:50.272033 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-701ba422-cc02-4efa-884d-99650662edae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:50.474936 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0c1342e3-404b-410d-862e-e4d803e2f158 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:50.484450 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0c1342e3-404b-410d-862e-e4d803e2f158 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1766 microversion: 2.1 time: 0.252329 Feb 17 03:37:50.485266 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 619/1245] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:50 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1766 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:50.489149 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-701ba422-cc02-4efa-884d-99650662edae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:50.490074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-102b5a32-f174-4556-8e83-4a04e0ce8378 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:50.491196 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-102b5a32-f174-4556-8e83-4a04e0ce8378 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:50.499647 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-102b5a32-f174-4556-8e83-4a04e0ce8378 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:50.500151 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-102b5a32-f174-4556-8e83-4a04e0ce8378 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:50.500999 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-102b5a32-f174-4556-8e83-4a04e0ce8378 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:50.501731 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-102b5a32-f174-4556-8e83-4a04e0ce8378 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:50.502571 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-701ba422-cc02-4efa-884d-99650662edae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:50.503933 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-701ba422-cc02-4efa-884d-99650662edae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:50.505224 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-701ba422-cc02-4efa-884d-99650662edae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1744 microversion: 2.20 time: 0.249712 Feb 17 03:37:50.505798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 627/1246] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:50 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1744 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:37:50.624258 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-102b5a32-f174-4556-8e83-4a04e0ce8378 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.137660 Feb 17 03:37:50.625303 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 620/1247] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:50 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:51.512416 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-96ad73c9-9866-4480-ae43-d931721e0515 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:51.513978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-96ad73c9-9866-4480-ae43-d931721e0515 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:51.525196 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-dfb3112a-5b9d-4285-a38f-8651631b4f4e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:51.529915 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-dfb3112a-5b9d-4285-a38f-8651631b4f4e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:51.536459 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-96ad73c9-9866-4480-ae43-d931721e0515 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:51.541538 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-96ad73c9-9866-4480-ae43-d931721e0515 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:51.542660 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-96ad73c9-9866-4480-ae43-d931721e0515 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:51.543362 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-96ad73c9-9866-4480-ae43-d931721e0515 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:51.545783 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dfb3112a-5b9d-4285-a38f-8651631b4f4e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:51.557753 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dfb3112a-5b9d-4285-a38f-8651631b4f4e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:51.558662 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dfb3112a-5b9d-4285-a38f-8651631b4f4e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:51.559168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dfb3112a-5b9d-4285-a38f-8651631b4f4e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:51.822869 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dfb3112a-5b9d-4285-a38f-8651631b4f4e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:51.839555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dfb3112a-5b9d-4285-a38f-8651631b4f4e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:51.841469 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dfb3112a-5b9d-4285-a38f-8651631b4f4e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:51.842732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-dfb3112a-5b9d-4285-a38f-8651631b4f4e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1739 microversion: 2.20 time: 0.322460 Feb 17 03:37:51.844529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 621/1248] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:51 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1739 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:37:51.861903 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f883c414-ec7f-4b18-bbc7-e6bc1efd0957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:51.863056 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f883c414-ec7f-4b18-bbc7-e6bc1efd0957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:51.871937 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f883c414-ec7f-4b18-bbc7-e6bc1efd0957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:51.872460 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f883c414-ec7f-4b18-bbc7-e6bc1efd0957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:51.873375 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f883c414-ec7f-4b18-bbc7-e6bc1efd0957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:51.873878 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f883c414-ec7f-4b18-bbc7-e6bc1efd0957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:52.034797 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f883c414-ec7f-4b18-bbc7-e6bc1efd0957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.177650 Feb 17 03:37:52.037345 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 622/1249] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:51 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:52.104728 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-96ad73c9-9866-4480-ae43-d931721e0515 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:52.119286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-96ad73c9-9866-4480-ae43-d931721e0515 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1766 microversion: 2.1 time: 0.620314 Feb 17 03:37:52.120151 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 628/1250] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:51 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1766 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:52.890494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2aff03d5-76e4-4068-8293-a0e004c1c91f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:52.891299 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2aff03d5-76e4-4068-8293-a0e004c1c91f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:52.906814 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2aff03d5-76e4-4068-8293-a0e004c1c91f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:52.907321 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2aff03d5-76e4-4068-8293-a0e004c1c91f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:52.908744 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2aff03d5-76e4-4068-8293-a0e004c1c91f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:52.909266 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2aff03d5-76e4-4068-8293-a0e004c1c91f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:53.168654 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e2ee37f9-fa10-47c1-a1c8-9775f272b727 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:53.170551 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e2ee37f9-fa10-47c1-a1c8-9775f272b727 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:53.178991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2ee37f9-fa10-47c1-a1c8-9775f272b727 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:53.180228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2ee37f9-fa10-47c1-a1c8-9775f272b727 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:53.181381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2ee37f9-fa10-47c1-a1c8-9775f272b727 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:53.182088 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2ee37f9-fa10-47c1-a1c8-9775f272b727 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:53.205659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2aff03d5-76e4-4068-8293-a0e004c1c91f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:53.216708 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2aff03d5-76e4-4068-8293-a0e004c1c91f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:53.218342 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2aff03d5-76e4-4068-8293-a0e004c1c91f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:53.219559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2aff03d5-76e4-4068-8293-a0e004c1c91f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1739 microversion: 2.20 time: 0.348246 Feb 17 03:37:53.221004 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 623/1251] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:52 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1739 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:37:53.227779 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-28adad34-f4b6-4e03-96ce-a2413b96d351 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:53.228456 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-28adad34-f4b6-4e03-96ce-a2413b96d351 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:53.237075 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-28adad34-f4b6-4e03-96ce-a2413b96d351 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:53.237591 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-28adad34-f4b6-4e03-96ce-a2413b96d351 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:53.238452 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-28adad34-f4b6-4e03-96ce-a2413b96d351 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:53.238951 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-28adad34-f4b6-4e03-96ce-a2413b96d351 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:53.341298 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e2ee37f9-fa10-47c1-a1c8-9775f272b727 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.296819 Feb 17 03:37:53.341994 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 629/1252] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:53 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:37:53.483663 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-28adad34-f4b6-4e03-96ce-a2413b96d351 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:53.495994 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-28adad34-f4b6-4e03-96ce-a2413b96d351 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1769 microversion: 2.1 time: 0.273937 Feb 17 03:37:53.496896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 624/1253] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:37:53 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1769 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:37:54.240935 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-35de5e0a-0b31-4717-8277-05d2ba8eba90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:54.241755 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-35de5e0a-0b31-4717-8277-05d2ba8eba90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:54.250977 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-35de5e0a-0b31-4717-8277-05d2ba8eba90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:54.251968 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-35de5e0a-0b31-4717-8277-05d2ba8eba90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:54.253519 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-35de5e0a-0b31-4717-8277-05d2ba8eba90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:54.254231 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-35de5e0a-0b31-4717-8277-05d2ba8eba90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:54.355702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9d4730ac-fb2a-49b8-91dd-57f248e2417d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:54.357495 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9d4730ac-fb2a-49b8-91dd-57f248e2417d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:54.368126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9d4730ac-fb2a-49b8-91dd-57f248e2417d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:54.369015 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9d4730ac-fb2a-49b8-91dd-57f248e2417d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:54.370175 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9d4730ac-fb2a-49b8-91dd-57f248e2417d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:54.370881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9d4730ac-fb2a-49b8-91dd-57f248e2417d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:54.497237 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-35de5e0a-0b31-4717-8277-05d2ba8eba90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:54.507938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-35de5e0a-0b31-4717-8277-05d2ba8eba90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:54.510199 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-35de5e0a-0b31-4717-8277-05d2ba8eba90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:54.511764 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-35de5e0a-0b31-4717-8277-05d2ba8eba90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1739 microversion: 2.20 time: 0.276044 Feb 17 03:37:54.512467 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 630/1254] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:54 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1739 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:37:54.526461 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9d4730ac-fb2a-49b8-91dd-57f248e2417d tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.175325 Feb 17 03:37:54.531688 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 625/1255] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:54 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:54.536944 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:37:54.537400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:37:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:37:55.531881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-01e0ef1b-a017-4d8c-bea0-01556b800b11 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:55.532696 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-01e0ef1b-a017-4d8c-bea0-01556b800b11 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:55.540845 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4087af77-40a0-4d9d-bd9b-aa439c1e232e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:55.542284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4087af77-40a0-4d9d-bd9b-aa439c1e232e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:55.546462 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-01e0ef1b-a017-4d8c-bea0-01556b800b11 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:55.546970 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-01e0ef1b-a017-4d8c-bea0-01556b800b11 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:55.547823 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-01e0ef1b-a017-4d8c-bea0-01556b800b11 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:55.548399 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-01e0ef1b-a017-4d8c-bea0-01556b800b11 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:55.551621 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4087af77-40a0-4d9d-bd9b-aa439c1e232e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:55.552248 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4087af77-40a0-4d9d-bd9b-aa439c1e232e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:55.552991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4087af77-40a0-4d9d-bd9b-aa439c1e232e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:55.553858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4087af77-40a0-4d9d-bd9b-aa439c1e232e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:55.685060 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4087af77-40a0-4d9d-bd9b-aa439c1e232e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.148458 Feb 17 03:37:55.687053 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 626/1256] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:55 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:55.766033 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-01e0ef1b-a017-4d8c-bea0-01556b800b11 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:55.775926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-01e0ef1b-a017-4d8c-bea0-01556b800b11 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:55.777551 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-01e0ef1b-a017-4d8c-bea0-01556b800b11 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:55.778789 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-01e0ef1b-a017-4d8c-bea0-01556b800b11 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1739 microversion: 2.20 time: 0.251124 Feb 17 03:37:55.779430 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 631/1257] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:55 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:37:56.699368 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ffa77377-c81e-486f-8c39-be62b3c80f4c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:56.700668 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ffa77377-c81e-486f-8c39-be62b3c80f4c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:56.711910 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ffa77377-c81e-486f-8c39-be62b3c80f4c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:56.712386 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ffa77377-c81e-486f-8c39-be62b3c80f4c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:56.713349 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ffa77377-c81e-486f-8c39-be62b3c80f4c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:56.713841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ffa77377-c81e-486f-8c39-be62b3c80f4c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:56.801409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5866e0b9-a739-4316-b225-e254db97294a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:56.802378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5866e0b9-a739-4316-b225-e254db97294a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:56.810309 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5866e0b9-a739-4316-b225-e254db97294a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:56.811573 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5866e0b9-a739-4316-b225-e254db97294a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:56.813240 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5866e0b9-a739-4316-b225-e254db97294a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:56.814159 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5866e0b9-a739-4316-b225-e254db97294a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:56.842332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ffa77377-c81e-486f-8c39-be62b3c80f4c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.147545 Feb 17 03:37:56.858091 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 627/1258] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:56 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:57.064748 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5866e0b9-a739-4316-b225-e254db97294a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:57.075172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5866e0b9-a739-4316-b225-e254db97294a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:57.077255 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5866e0b9-a739-4316-b225-e254db97294a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:57.078677 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5866e0b9-a739-4316-b225-e254db97294a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1739 microversion: 2.20 time: 0.283145 Feb 17 03:37:57.079568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 632/1259] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:56 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:37:57.861851 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-97bdca6a-7e1b-4b3d-b22b-1a00e9f349d4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:57.867472 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-97bdca6a-7e1b-4b3d-b22b-1a00e9f349d4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:57.883501 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-97bdca6a-7e1b-4b3d-b22b-1a00e9f349d4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:57.884374 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-97bdca6a-7e1b-4b3d-b22b-1a00e9f349d4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:57.885734 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-97bdca6a-7e1b-4b3d-b22b-1a00e9f349d4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:57.886564 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-97bdca6a-7e1b-4b3d-b22b-1a00e9f349d4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:58.027509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-97bdca6a-7e1b-4b3d-b22b-1a00e9f349d4 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.174895 Feb 17 03:37:58.028703 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 628/1260] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:57 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:58.099379 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6f9daf05-bfc6-4bbe-8e94-ed478326cf91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:58.100089 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6f9daf05-bfc6-4bbe-8e94-ed478326cf91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:58.108745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6f9daf05-bfc6-4bbe-8e94-ed478326cf91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:58.109277 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6f9daf05-bfc6-4bbe-8e94-ed478326cf91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:58.110353 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6f9daf05-bfc6-4bbe-8e94-ed478326cf91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:58.111651 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6f9daf05-bfc6-4bbe-8e94-ed478326cf91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:58.351089 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6f9daf05-bfc6-4bbe-8e94-ed478326cf91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:58.361873 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6f9daf05-bfc6-4bbe-8e94-ed478326cf91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:58.363746 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6f9daf05-bfc6-4bbe-8e94-ed478326cf91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:58.365476 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6f9daf05-bfc6-4bbe-8e94-ed478326cf91 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1739 microversion: 2.20 time: 0.270761 Feb 17 03:37:58.365614 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 633/1261] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:58 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:37:59.042397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-75856b63-445a-474d-a5b6-dbad2038ae3e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:37:59.043858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-75856b63-445a-474d-a5b6-dbad2038ae3e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:59.057393 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-75856b63-445a-474d-a5b6-dbad2038ae3e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:59.057900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-75856b63-445a-474d-a5b6-dbad2038ae3e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:59.058770 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-75856b63-445a-474d-a5b6-dbad2038ae3e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:59.060296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-75856b63-445a-474d-a5b6-dbad2038ae3e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:59.193247 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-75856b63-445a-474d-a5b6-dbad2038ae3e tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.155190 Feb 17 03:37:59.194689 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 629/1262] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:37:59 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:37:59.425607 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-58abd443-e460-4587-90f0-157f24506796 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:37:59.426276 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-58abd443-e460-4587-90f0-157f24506796 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:37:59.434788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-58abd443-e460-4587-90f0-157f24506796 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:59.435303 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-58abd443-e460-4587-90f0-157f24506796 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:59.436161 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-58abd443-e460-4587-90f0-157f24506796 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:37:59.436658 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-58abd443-e460-4587-90f0-157f24506796 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:37:59.671191 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-58abd443-e460-4587-90f0-157f24506796 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:59.684708 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-58abd443-e460-4587-90f0-157f24506796 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:59.686916 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-58abd443-e460-4587-90f0-157f24506796 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:37:59.688328 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-58abd443-e460-4587-90f0-157f24506796 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1739 microversion: 2.20 time: 0.308408 Feb 17 03:37:59.688951 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 634/1263] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:37:59 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1739 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:00.209067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ad7ab1c3-64ab-4c74-9245-1d005a0f44f2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:38:00.210327 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ad7ab1c3-64ab-4c74-9245-1d005a0f44f2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:00.218690 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad7ab1c3-64ab-4c74-9245-1d005a0f44f2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:00.219232 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad7ab1c3-64ab-4c74-9245-1d005a0f44f2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:00.220442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad7ab1c3-64ab-4c74-9245-1d005a0f44f2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:00.220902 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad7ab1c3-64ab-4c74-9245-1d005a0f44f2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:00.352568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ad7ab1c3-64ab-4c74-9245-1d005a0f44f2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.148454 Feb 17 03:38:00.353335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 630/1264] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:38:00 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:38:00.710314 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b1f287de-8249-47d3-bbdc-d0b314844672 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:00.710986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b1f287de-8249-47d3-bbdc-d0b314844672 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:00.718940 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b1f287de-8249-47d3-bbdc-d0b314844672 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:00.719450 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b1f287de-8249-47d3-bbdc-d0b314844672 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:00.720941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b1f287de-8249-47d3-bbdc-d0b314844672 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:00.721734 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b1f287de-8249-47d3-bbdc-d0b314844672 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:00.941775 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b1f287de-8249-47d3-bbdc-d0b314844672 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:00.951943 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b1f287de-8249-47d3-bbdc-d0b314844672 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:00.953548 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b1f287de-8249-47d3-bbdc-d0b314844672 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:00.955246 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b1f287de-8249-47d3-bbdc-d0b314844672 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1739 microversion: 2.20 time: 0.248646 Feb 17 03:38:00.955801 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 635/1265] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:00 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:01.370157 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c0f83b1f-1e36-48f1-a59c-2f9c853ea3fe tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:38:01.371430 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c0f83b1f-1e36-48f1-a59c-2f9c853ea3fe tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:01.380554 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c0f83b1f-1e36-48f1-a59c-2f9c853ea3fe tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:01.381111 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c0f83b1f-1e36-48f1-a59c-2f9c853ea3fe tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:01.381987 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c0f83b1f-1e36-48f1-a59c-2f9c853ea3fe tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:01.382461 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c0f83b1f-1e36-48f1-a59c-2f9c853ea3fe tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:01.518307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c0f83b1f-1e36-48f1-a59c-2f9c853ea3fe tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.156126 Feb 17 03:38:01.519030 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 631/1266] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:38:01 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:38:01.975264 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9642e88a-1d45-423d-a7b0-d9559bf225ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:01.976006 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9642e88a-1d45-423d-a7b0-d9559bf225ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:01.983975 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9642e88a-1d45-423d-a7b0-d9559bf225ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:01.984474 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9642e88a-1d45-423d-a7b0-d9559bf225ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:01.985349 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9642e88a-1d45-423d-a7b0-d9559bf225ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:01.986498 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9642e88a-1d45-423d-a7b0-d9559bf225ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:02.336667 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9642e88a-1d45-423d-a7b0-d9559bf225ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:02.347793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9642e88a-1d45-423d-a7b0-d9559bf225ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:02.349397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9642e88a-1d45-423d-a7b0-d9559bf225ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:02.350601 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9642e88a-1d45-423d-a7b0-d9559bf225ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1721 microversion: 2.20 time: 0.379503 Feb 17 03:38:02.351188 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 636/1267] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:01 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1721 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:38:02.531377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-466b86b1-3a61-4d3a-968c-25a51a38e1bb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:38:02.532454 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-466b86b1-3a61-4d3a-968c-25a51a38e1bb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:02.541732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-466b86b1-3a61-4d3a-968c-25a51a38e1bb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:02.542262 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-466b86b1-3a61-4d3a-968c-25a51a38e1bb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:02.543095 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-466b86b1-3a61-4d3a-968c-25a51a38e1bb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:02.543592 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-466b86b1-3a61-4d3a-968c-25a51a38e1bb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:02.678693 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-466b86b1-3a61-4d3a-968c-25a51a38e1bb tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 28695 microversion: 2.1 time: 0.151871 Feb 17 03:38:02.679415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 632/1268] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:38:02 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 28695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:38:03.370819 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-23ee4a9c-769e-4c44-9033-ab61fbd43e94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:03.371408 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-23ee4a9c-769e-4c44-9033-ab61fbd43e94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:03.379674 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-23ee4a9c-769e-4c44-9033-ab61fbd43e94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:03.380176 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-23ee4a9c-769e-4c44-9033-ab61fbd43e94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:03.381010 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-23ee4a9c-769e-4c44-9033-ab61fbd43e94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:03.381519 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-23ee4a9c-769e-4c44-9033-ab61fbd43e94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:03.600787 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-23ee4a9c-769e-4c44-9033-ab61fbd43e94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:03.610385 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-23ee4a9c-769e-4c44-9033-ab61fbd43e94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:03.612570 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-23ee4a9c-769e-4c44-9033-ab61fbd43e94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:03.613799 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-23ee4a9c-769e-4c44-9033-ab61fbd43e94 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1721 microversion: 2.20 time: 0.247171 Feb 17 03:38:03.614383 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 637/1269] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:03 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:03.691082 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0521df77-2d93-4db6-bb84-4de0a13d93e0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:38:03.692218 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0521df77-2d93-4db6-bb84-4de0a13d93e0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:03.701192 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0521df77-2d93-4db6-bb84-4de0a13d93e0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:03.701698 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0521df77-2d93-4db6-bb84-4de0a13d93e0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:03.702547 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0521df77-2d93-4db6-bb84-4de0a13d93e0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:03.703060 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0521df77-2d93-4db6-bb84-4de0a13d93e0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:03.840273 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0521df77-2d93-4db6-bb84-4de0a13d93e0 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 29183 microversion: 2.1 time: 0.153601 Feb 17 03:38:03.841290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 633/1270] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:38:03 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 29183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:38:04.634374 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4f31eac6-12a9-48c9-a71f-bad30ebecd40 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:04.635041 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4f31eac6-12a9-48c9-a71f-bad30ebecd40 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:04.643535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4f31eac6-12a9-48c9-a71f-bad30ebecd40 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:04.644038 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4f31eac6-12a9-48c9-a71f-bad30ebecd40 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:04.644879 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4f31eac6-12a9-48c9-a71f-bad30ebecd40 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:04.645429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4f31eac6-12a9-48c9-a71f-bad30ebecd40 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:04.853958 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9a2bb041-cb59-4a1d-b0e9-b3d34ad1e884 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:38:04.855756 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9a2bb041-cb59-4a1d-b0e9-b3d34ad1e884 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:04.866677 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4f31eac6-12a9-48c9-a71f-bad30ebecd40 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:04.867247 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a2bb041-cb59-4a1d-b0e9-b3d34ad1e884 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:04.867963 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a2bb041-cb59-4a1d-b0e9-b3d34ad1e884 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:04.869008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a2bb041-cb59-4a1d-b0e9-b3d34ad1e884 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:04.869729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9a2bb041-cb59-4a1d-b0e9-b3d34ad1e884 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:04.877092 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4f31eac6-12a9-48c9-a71f-bad30ebecd40 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:04.878702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4f31eac6-12a9-48c9-a71f-bad30ebecd40 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:04.879903 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4f31eac6-12a9-48c9-a71f-bad30ebecd40 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1724 microversion: 2.20 time: 0.250086 Feb 17 03:38:04.881378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 638/1271] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:04 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:04.899118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fc5a1b58-2e20-4ae2-8043-fd09af03476f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "def55414-b4a3-4b4f-a0ee-db21781e3cf0"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:38:04.901244 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fc5a1b58-2e20-4ae2-8043-fd09af03476f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:04.911110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fc5a1b58-2e20-4ae2-8043-fd09af03476f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:04.911110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fc5a1b58-2e20-4ae2-8043-fd09af03476f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:04.911110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fc5a1b58-2e20-4ae2-8043-fd09af03476f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:04.911639 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fc5a1b58-2e20-4ae2-8043-fd09af03476f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:05.015129 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9a2bb041-cb59-4a1d-b0e9-b3d34ad1e884 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 31154 microversion: 2.1 time: 0.166036 Feb 17 03:38:05.019418 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 634/1272] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:38:04 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 31154 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:38:05.024063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-ce3552ad-d4eb-4f4b-ae6c-711708b65f93 req-9630ae0c-4d7c-48a4-9001-7fcf93f18933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb13b0aa-8bce-4878-943d-e3483a430b36", "name": "network-vif-unplugged", "status": "completed", "tag": "3536cbed-2c8d-4d95-bbc0-f2840e848748"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:38:05.025758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:38:05.025758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:38:05.035165 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-ce3552ad-d4eb-4f4b-ae6c-711708b65f93 req-9630ae0c-4d7c-48a4-9001-7fcf93f18933 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:05.035692 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-ce3552ad-d4eb-4f4b-ae6c-711708b65f93 req-9630ae0c-4d7c-48a4-9001-7fcf93f18933 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:05.053895 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.compute.server_external_events [req-ce3552ad-d4eb-4f4b-ae6c-711708b65f93 req-9630ae0c-4d7c-48a4-9001-7fcf93f18933 service nova] Unable to find a host for instance eb13b0aa-8bce-4878-943d-e3483a430b36. Dropping event network-vif-unplugged {{(pid=98103) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Feb 17 03:38:05.054850 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-ce3552ad-d4eb-4f4b-ae6c-711708b65f93 req-9630ae0c-4d7c-48a4-9001-7fcf93f18933 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037264 Feb 17 03:38:05.055485 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 635/1273] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:38:05 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 17 03:38:05.365927 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fc5a1b58-2e20-4ae2-8043-fd09af03476f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.471272 Feb 17 03:38:05.366584 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 639/1274] 10.222.0.57 () {62 vars in 1354 bytes} [Wed Feb 17 03:38:04 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/os-volume_attachments => generated 188 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:38:05.486709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f4a73e6a-6f07-4c78-b679-d177582bc645 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:05.487387 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f4a73e6a-6f07-4c78-b679-d177582bc645 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:05.496294 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4a73e6a-6f07-4c78-b679-d177582bc645 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:05.496805 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4a73e6a-6f07-4c78-b679-d177582bc645 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:05.497687 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4a73e6a-6f07-4c78-b679-d177582bc645 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:05.498178 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f4a73e6a-6f07-4c78-b679-d177582bc645 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:05.950031 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f4a73e6a-6f07-4c78-b679-d177582bc645 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "DELETE /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/os-volume_attachments/def55414-b4a3-4b4f-a0ee-db21781e3cf0" status: 202 len: 0 microversion: 2.20 time: 0.467564 Feb 17 03:38:05.950668 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 636/1275] 10.222.0.57 () {60 vars in 1447 bytes} [Wed Feb 17 03:38:05 2021] DELETE /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/os-volume_attachments/def55414-b4a3-4b4f-a0ee-db21781e3cf0 => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 17 03:38:06.027723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fb01b1d2-90a2-4167-bf5a-d627c9917002 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:38:06.029000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fb01b1d2-90a2-4167-bf5a-d627c9917002 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:06.037115 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fb01b1d2-90a2-4167-bf5a-d627c9917002 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:06.037637 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fb01b1d2-90a2-4167-bf5a-d627c9917002 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:06.038503 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fb01b1d2-90a2-4167-bf5a-d627c9917002 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:06.039004 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fb01b1d2-90a2-4167-bf5a-d627c9917002 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:06.057398 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fc176078-7264-4430-b12a-d02726e12fb7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:38:06.058107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fc176078-7264-4430-b12a-d02726e12fb7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:06.068301 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fc176078-7264-4430-b12a-d02726e12fb7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:06.068806 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fc176078-7264-4430-b12a-d02726e12fb7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:06.069729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fc176078-7264-4430-b12a-d02726e12fb7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:06.070231 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fc176078-7264-4430-b12a-d02726e12fb7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:06.197079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fb01b1d2-90a2-4167-bf5a-d627c9917002 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 32900 microversion: 2.1 time: 0.173002 Feb 17 03:38:06.197813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 640/1276] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:38:06 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 32900 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:38:06.237582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fc176078-7264-4430-b12a-d02726e12fb7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action" status: 202 len: 0 microversion: 2.20 time: 0.184240 Feb 17 03:38:06.238173 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 637/1277] 10.222.0.57 () {62 vars in 1309 bytes} [Wed Feb 17 03:38:06 2021] POST /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 17 03:38:06.247792 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e0a40745-a30d-49fa-b2e8-397b6cdf9aa7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:06.248559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e0a40745-a30d-49fa-b2e8-397b6cdf9aa7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:06.258084 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e0a40745-a30d-49fa-b2e8-397b6cdf9aa7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:06.258592 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e0a40745-a30d-49fa-b2e8-397b6cdf9aa7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:06.259502 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e0a40745-a30d-49fa-b2e8-397b6cdf9aa7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:06.259996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e0a40745-a30d-49fa-b2e8-397b6cdf9aa7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:06.480315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e0a40745-a30d-49fa-b2e8-397b6cdf9aa7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:06.490577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e0a40745-a30d-49fa-b2e8-397b6cdf9aa7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:06.492093 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e0a40745-a30d-49fa-b2e8-397b6cdf9aa7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:06.493325 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e0a40745-a30d-49fa-b2e8-397b6cdf9aa7 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1672 microversion: 2.20 time: 0.250339 Feb 17 03:38:06.493908 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 641/1278] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:06 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1672 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:07.211394 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6294f5a1-3056-4fb8-a09c-1e1b2f35997b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:38:07.212531 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6294f5a1-3056-4fb8-a09c-1e1b2f35997b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:07.220631 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6294f5a1-3056-4fb8-a09c-1e1b2f35997b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:07.221768 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6294f5a1-3056-4fb8-a09c-1e1b2f35997b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:07.222632 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6294f5a1-3056-4fb8-a09c-1e1b2f35997b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:07.223123 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6294f5a1-3056-4fb8-a09c-1e1b2f35997b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:07.360380 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6294f5a1-3056-4fb8-a09c-1e1b2f35997b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 33782 microversion: 2.1 time: 0.153197 Feb 17 03:38:07.361056 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 638/1279] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:38:07 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 33782 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 17 03:38:07.513992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-98142d3b-0af4-4bae-9a8b-b6176e35925e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:07.514807 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-98142d3b-0af4-4bae-9a8b-b6176e35925e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:07.524588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-98142d3b-0af4-4bae-9a8b-b6176e35925e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:07.525146 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-98142d3b-0af4-4bae-9a8b-b6176e35925e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:07.526016 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-98142d3b-0af4-4bae-9a8b-b6176e35925e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:07.526492 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-98142d3b-0af4-4bae-9a8b-b6176e35925e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:07.875404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-98142d3b-0af4-4bae-9a8b-b6176e35925e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:07.886027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-98142d3b-0af4-4bae-9a8b-b6176e35925e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:07.887644 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-98142d3b-0af4-4bae-9a8b-b6176e35925e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:07.889014 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-98142d3b-0af4-4bae-9a8b-b6176e35925e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1674 microversion: 2.20 time: 0.379037 Feb 17 03:38:07.891904 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 642/1280] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:07 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1674 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:08.373564 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f6dd68c7-85f8-40e3-a4c4-d15e2cd68c96 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:38:08.374699 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f6dd68c7-85f8-40e3-a4c4-d15e2cd68c96 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:08.383361 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6dd68c7-85f8-40e3-a4c4-d15e2cd68c96 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:08.383859 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6dd68c7-85f8-40e3-a4c4-d15e2cd68c96 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:08.384689 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6dd68c7-85f8-40e3-a4c4-d15e2cd68c96 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:08.385210 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6dd68c7-85f8-40e3-a4c4-d15e2cd68c96 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:08.530762 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f6dd68c7-85f8-40e3-a4c4-d15e2cd68c96 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 35007 microversion: 2.1 time: 0.161406 Feb 17 03:38:08.531487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 639/1281] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:38:08 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 35007 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:38:08.911288 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a4164c40-5e45-4407-9bee-f11a77f08e5b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:08.911288 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a4164c40-5e45-4407-9bee-f11a77f08e5b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:08.916758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4164c40-5e45-4407-9bee-f11a77f08e5b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:08.917263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4164c40-5e45-4407-9bee-f11a77f08e5b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:08.918122 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4164c40-5e45-4407-9bee-f11a77f08e5b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:08.918609 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a4164c40-5e45-4407-9bee-f11a77f08e5b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:09.198190 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a4164c40-5e45-4407-9bee-f11a77f08e5b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:09.214154 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a4164c40-5e45-4407-9bee-f11a77f08e5b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:09.215787 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a4164c40-5e45-4407-9bee-f11a77f08e5b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:09.217067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a4164c40-5e45-4407-9bee-f11a77f08e5b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.313053 Feb 17 03:38:09.217978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 643/1282] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:08 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:09.545320 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7397b48b-b0c4-4531-8a25-d59e4c366057 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:38:09.546403 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7397b48b-b0c4-4531-8a25-d59e4c366057 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:09.556926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7397b48b-b0c4-4531-8a25-d59e4c366057 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:09.557467 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7397b48b-b0c4-4531-8a25-d59e4c366057 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:09.558335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7397b48b-b0c4-4531-8a25-d59e4c366057 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:09.558824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7397b48b-b0c4-4531-8a25-d59e4c366057 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:10.244479 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-dad13c8b-2bc1-4474-bb01-14fc4a072cdc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:10.245093 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-dad13c8b-2bc1-4474-bb01-14fc4a072cdc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:10.253455 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dad13c8b-2bc1-4474-bb01-14fc4a072cdc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:10.254206 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dad13c8b-2bc1-4474-bb01-14fc4a072cdc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:10.255279 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dad13c8b-2bc1-4474-bb01-14fc4a072cdc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:10.255746 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dad13c8b-2bc1-4474-bb01-14fc4a072cdc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:10.490246 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dad13c8b-2bc1-4474-bb01-14fc4a072cdc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:10.500759 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dad13c8b-2bc1-4474-bb01-14fc4a072cdc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:10.502814 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dad13c8b-2bc1-4474-bb01-14fc4a072cdc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:10.504037 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-dad13c8b-2bc1-4474-bb01-14fc4a072cdc tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.263834 Feb 17 03:38:10.504634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 644/1283] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:10 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:11.527153 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6b65dd47-f092-43f8-8948-9ab4d80cf05f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:11.527817 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6b65dd47-f092-43f8-8948-9ab4d80cf05f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:11.536998 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6b65dd47-f092-43f8-8948-9ab4d80cf05f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:11.537536 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6b65dd47-f092-43f8-8948-9ab4d80cf05f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:11.538427 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6b65dd47-f092-43f8-8948-9ab4d80cf05f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:11.539130 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6b65dd47-f092-43f8-8948-9ab4d80cf05f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:11.771992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6b65dd47-f092-43f8-8948-9ab4d80cf05f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:11.782642 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6b65dd47-f092-43f8-8948-9ab4d80cf05f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:11.784205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6b65dd47-f092-43f8-8948-9ab4d80cf05f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:11.785538 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6b65dd47-f092-43f8-8948-9ab4d80cf05f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.264066 Feb 17 03:38:11.797324 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 645/1284] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:11 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:12.805568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a82ab331-dbac-4604-a923-a8c72eb2dda0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:12.806244 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a82ab331-dbac-4604-a923-a8c72eb2dda0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:12.814898 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a82ab331-dbac-4604-a923-a8c72eb2dda0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:12.815422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a82ab331-dbac-4604-a923-a8c72eb2dda0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:12.816263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a82ab331-dbac-4604-a923-a8c72eb2dda0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:12.816749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a82ab331-dbac-4604-a923-a8c72eb2dda0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:13.066198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a82ab331-dbac-4604-a923-a8c72eb2dda0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:13.077271 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a82ab331-dbac-4604-a923-a8c72eb2dda0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:13.079077 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a82ab331-dbac-4604-a923-a8c72eb2dda0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:13.080357 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a82ab331-dbac-4604-a923-a8c72eb2dda0 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.278983 Feb 17 03:38:13.081048 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 646/1285] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:12 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:38:14.101718 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0f0b5620-913b-475e-9ba8-f7aa37b67fed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:14.102385 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0f0b5620-913b-475e-9ba8-f7aa37b67fed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:14.110809 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0f0b5620-913b-475e-9ba8-f7aa37b67fed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:14.111326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0f0b5620-913b-475e-9ba8-f7aa37b67fed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:14.112167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0f0b5620-913b-475e-9ba8-f7aa37b67fed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:14.112652 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0f0b5620-913b-475e-9ba8-f7aa37b67fed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:14.568140 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0f0b5620-913b-475e-9ba8-f7aa37b67fed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:14.578601 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0f0b5620-913b-475e-9ba8-f7aa37b67fed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:14.580215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0f0b5620-913b-475e-9ba8-f7aa37b67fed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:14.581486 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0f0b5620-913b-475e-9ba8-f7aa37b67fed tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.485355 Feb 17 03:38:14.582068 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 647/1286] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:14 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:38:15.602688 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e397b192-18fa-4dc4-8d55-4ec9a6252a43 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:15.603350 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e397b192-18fa-4dc4-8d55-4ec9a6252a43 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:15.611342 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e397b192-18fa-4dc4-8d55-4ec9a6252a43 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:15.612136 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e397b192-18fa-4dc4-8d55-4ec9a6252a43 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:15.612972 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e397b192-18fa-4dc4-8d55-4ec9a6252a43 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:15.613536 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e397b192-18fa-4dc4-8d55-4ec9a6252a43 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:15.832419 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e397b192-18fa-4dc4-8d55-4ec9a6252a43 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:15.841981 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e397b192-18fa-4dc4-8d55-4ec9a6252a43 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:15.843568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e397b192-18fa-4dc4-8d55-4ec9a6252a43 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:15.844752 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e397b192-18fa-4dc4-8d55-4ec9a6252a43 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.246273 Feb 17 03:38:15.845372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 648/1287] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:15 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:38:16.864323 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-047fa377-4a8c-4f5f-bc58-7a26c163afad tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:16.865895 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-047fa377-4a8c-4f5f-bc58-7a26c163afad tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:16.874300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-047fa377-4a8c-4f5f-bc58-7a26c163afad tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:16.874957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-047fa377-4a8c-4f5f-bc58-7a26c163afad tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:16.875885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-047fa377-4a8c-4f5f-bc58-7a26c163afad tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:16.876458 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-047fa377-4a8c-4f5f-bc58-7a26c163afad tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:17.089759 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-047fa377-4a8c-4f5f-bc58-7a26c163afad tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:17.100974 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-047fa377-4a8c-4f5f-bc58-7a26c163afad tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:17.102602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-047fa377-4a8c-4f5f-bc58-7a26c163afad tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:17.103798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-047fa377-4a8c-4f5f-bc58-7a26c163afad tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.243576 Feb 17 03:38:17.104607 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 649/1288] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:16 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:18.125730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-732281c4-3c43-406f-a0f4-dd57378da094 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:18.128169 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-732281c4-3c43-406f-a0f4-dd57378da094 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:18.137738 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-732281c4-3c43-406f-a0f4-dd57378da094 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:18.138408 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-732281c4-3c43-406f-a0f4-dd57378da094 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:18.139214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-732281c4-3c43-406f-a0f4-dd57378da094 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:18.139703 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-732281c4-3c43-406f-a0f4-dd57378da094 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:18.366215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-732281c4-3c43-406f-a0f4-dd57378da094 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:18.385480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-732281c4-3c43-406f-a0f4-dd57378da094 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:18.388590 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-732281c4-3c43-406f-a0f4-dd57378da094 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:18.390794 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-732281c4-3c43-406f-a0f4-dd57378da094 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.269962 Feb 17 03:38:18.391879 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 650/1289] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:18 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:38:19.419039 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-88786f47-336e-43a2-8606-80e834aa26b3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:19.419825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-88786f47-336e-43a2-8606-80e834aa26b3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:19.428909 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-88786f47-336e-43a2-8606-80e834aa26b3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:19.429448 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-88786f47-336e-43a2-8606-80e834aa26b3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:19.430304 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-88786f47-336e-43a2-8606-80e834aa26b3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:19.430801 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-88786f47-336e-43a2-8606-80e834aa26b3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:19.654019 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-88786f47-336e-43a2-8606-80e834aa26b3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:19.665201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-88786f47-336e-43a2-8606-80e834aa26b3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:19.666790 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-88786f47-336e-43a2-8606-80e834aa26b3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:19.667982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-88786f47-336e-43a2-8606-80e834aa26b3 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.253559 Feb 17 03:38:19.668593 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 651/1290] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:19 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:38:20.688294 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1643e83a-064a-4264-b3d7-e229718c25ba tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:20.689171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1643e83a-064a-4264-b3d7-e229718c25ba tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:20.699783 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1643e83a-064a-4264-b3d7-e229718c25ba tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:20.700291 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1643e83a-064a-4264-b3d7-e229718c25ba tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:20.701171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1643e83a-064a-4264-b3d7-e229718c25ba tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:20.701672 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1643e83a-064a-4264-b3d7-e229718c25ba tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:20.919873 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1643e83a-064a-4264-b3d7-e229718c25ba tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:20.929968 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1643e83a-064a-4264-b3d7-e229718c25ba tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:20.931559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1643e83a-064a-4264-b3d7-e229718c25ba tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:20.932747 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1643e83a-064a-4264-b3d7-e229718c25ba tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.249305 Feb 17 03:38:20.933366 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 652/1291] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:20 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:38:21.952172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e2318469-879a-49d4-ad19-81e793c19911 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:21.952874 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e2318469-879a-49d4-ad19-81e793c19911 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:21.961663 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2318469-879a-49d4-ad19-81e793c19911 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:21.962168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2318469-879a-49d4-ad19-81e793c19911 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:21.963005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2318469-879a-49d4-ad19-81e793c19911 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:21.963498 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e2318469-879a-49d4-ad19-81e793c19911 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:22.178055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e2318469-879a-49d4-ad19-81e793c19911 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:22.187850 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e2318469-879a-49d4-ad19-81e793c19911 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:22.189458 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e2318469-879a-49d4-ad19-81e793c19911 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:22.191305 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e2318469-879a-49d4-ad19-81e793c19911 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.243471 Feb 17 03:38:22.191892 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 653/1292] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:21 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:38:23.211628 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-be95b7a1-f2f8-4662-bbb3-dc3682801b65 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:23.212187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-be95b7a1-f2f8-4662-bbb3-dc3682801b65 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:23.220881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be95b7a1-f2f8-4662-bbb3-dc3682801b65 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:23.221454 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be95b7a1-f2f8-4662-bbb3-dc3682801b65 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:23.222304 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be95b7a1-f2f8-4662-bbb3-dc3682801b65 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:23.222837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-be95b7a1-f2f8-4662-bbb3-dc3682801b65 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:23.432067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-be95b7a1-f2f8-4662-bbb3-dc3682801b65 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:23.441916 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-be95b7a1-f2f8-4662-bbb3-dc3682801b65 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:23.443517 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-be95b7a1-f2f8-4662-bbb3-dc3682801b65 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:23.444690 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-be95b7a1-f2f8-4662-bbb3-dc3682801b65 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.237304 Feb 17 03:38:23.445308 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 654/1293] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:23 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:38:23.899057 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7397b48b-b0c4-4531-8a25-d59e4c366057 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action" status: 200 len: 38352 microversion: 2.1 time: 14.357729 Feb 17 03:38:23.905566 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 640/1294] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:38:09 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/action => generated 38352 bytes in 14361 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 17 03:38:23.911310 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8514f7ba-37d5-4a9d-80ad-529044747f04 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:23.911894 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8514f7ba-37d5-4a9d-80ad-529044747f04 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:23.919805 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8514f7ba-37d5-4a9d-80ad-529044747f04 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:23.920327 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8514f7ba-37d5-4a9d-80ad-529044747f04 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:23.921205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8514f7ba-37d5-4a9d-80ad-529044747f04 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:23.921720 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8514f7ba-37d5-4a9d-80ad-529044747f04 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:23.985376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8514f7ba-37d5-4a9d-80ad-529044747f04 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/ips" status: 200 len: 147 microversion: 2.1 time: 0.078428 Feb 17 03:38:23.986025 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 655/1295] 10.222.0.57 () {58 vars in 1238 bytes} [Wed Feb 17 03:38:23 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/ips => generated 147 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:38:24.465717 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2be083c3-0d68-451b-b055-68eb2fd8d402 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:24.466509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2be083c3-0d68-451b-b055-68eb2fd8d402 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:24.476766 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2be083c3-0d68-451b-b055-68eb2fd8d402 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:24.477346 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2be083c3-0d68-451b-b055-68eb2fd8d402 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:24.478397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2be083c3-0d68-451b-b055-68eb2fd8d402 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:24.479076 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2be083c3-0d68-451b-b055-68eb2fd8d402 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:24.697295 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2be083c3-0d68-451b-b055-68eb2fd8d402 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:24.707522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2be083c3-0d68-451b-b055-68eb2fd8d402 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:24.709143 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2be083c3-0d68-451b-b055-68eb2fd8d402 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:24.710339 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2be083c3-0d68-451b-b055-68eb2fd8d402 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.249322 Feb 17 03:38:24.710936 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 641/1296] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:24 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:25.591962 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6739617b-1f15-47dc-92ee-77988d164559 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00363622-cf61-4a18-b07a-4022b12ea8d4"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:38:25.593275 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6739617b-1f15-47dc-92ee-77988d164559 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:25.601699 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6739617b-1f15-47dc-92ee-77988d164559 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:25.602201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6739617b-1f15-47dc-92ee-77988d164559 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:25.603041 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6739617b-1f15-47dc-92ee-77988d164559 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:25.603934 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6739617b-1f15-47dc-92ee-77988d164559 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:25.730012 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bdeef95e-ed46-4e2f-948d-3a2d9f8a2bc9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:25.730680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bdeef95e-ed46-4e2f-948d-3a2d9f8a2bc9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:25.740429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bdeef95e-ed46-4e2f-948d-3a2d9f8a2bc9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:25.740946 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bdeef95e-ed46-4e2f-948d-3a2d9f8a2bc9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:25.741808 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bdeef95e-ed46-4e2f-948d-3a2d9f8a2bc9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:25.742293 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bdeef95e-ed46-4e2f-948d-3a2d9f8a2bc9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:25.959627 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bdeef95e-ed46-4e2f-948d-3a2d9f8a2bc9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:25.969194 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bdeef95e-ed46-4e2f-948d-3a2d9f8a2bc9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:25.970803 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bdeef95e-ed46-4e2f-948d-3a2d9f8a2bc9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:25.972558 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bdeef95e-ed46-4e2f-948d-3a2d9f8a2bc9 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.246772 Feb 17 03:38:25.973168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 642/1297] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:25 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:38:26.027828 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6739617b-1f15-47dc-92ee-77988d164559 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.440841 Feb 17 03:38:26.028496 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 656/1298] 10.222.0.57 () {60 vars in 1313 bytes} [Wed Feb 17 03:38:25 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-volume_attachments => generated 194 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:38:26.992328 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5a54f07a-4665-47e4-8a0f-2631f291ba8b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:26.993082 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5a54f07a-4665-47e4-8a0f-2631f291ba8b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:27.000985 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a54f07a-4665-47e4-8a0f-2631f291ba8b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:27.001526 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a54f07a-4665-47e4-8a0f-2631f291ba8b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:27.002898 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a54f07a-4665-47e4-8a0f-2631f291ba8b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:27.003369 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a54f07a-4665-47e4-8a0f-2631f291ba8b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:27.224798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5a54f07a-4665-47e4-8a0f-2631f291ba8b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:27.234662 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5a54f07a-4665-47e4-8a0f-2631f291ba8b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:27.236245 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5a54f07a-4665-47e4-8a0f-2631f291ba8b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:27.237977 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5a54f07a-4665-47e4-8a0f-2631f291ba8b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.249860 Feb 17 03:38:27.238550 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 643/1299] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:26 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:28.258327 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c3a543b5-28f4-489f-b843-00e8e40d5660 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:28.259102 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c3a543b5-28f4-489f-b843-00e8e40d5660 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:28.268799 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3a543b5-28f4-489f-b843-00e8e40d5660 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:28.269339 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3a543b5-28f4-489f-b843-00e8e40d5660 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:28.270199 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3a543b5-28f4-489f-b843-00e8e40d5660 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:28.270697 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c3a543b5-28f4-489f-b843-00e8e40d5660 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:28.484029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c3a543b5-28f4-489f-b843-00e8e40d5660 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:28.493653 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c3a543b5-28f4-489f-b843-00e8e40d5660 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:28.495219 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c3a543b5-28f4-489f-b843-00e8e40d5660 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:28.496410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c3a543b5-28f4-489f-b843-00e8e40d5660 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.243195 Feb 17 03:38:28.497596 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 657/1300] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:28 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:29.518735 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-76978329-061e-4161-8903-906011d847ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:29.519410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-76978329-061e-4161-8903-906011d847ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:29.527786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-76978329-061e-4161-8903-906011d847ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:29.528293 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-76978329-061e-4161-8903-906011d847ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:29.529166 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-76978329-061e-4161-8903-906011d847ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:29.529658 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-76978329-061e-4161-8903-906011d847ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:29.741228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-76978329-061e-4161-8903-906011d847ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:29.750818 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-76978329-061e-4161-8903-906011d847ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:29.752411 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-76978329-061e-4161-8903-906011d847ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:29.753640 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-76978329-061e-4161-8903-906011d847ae tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.239460 Feb 17 03:38:29.754228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 644/1301] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:29 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:30.772784 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-831f1a5e-e4a4-49ae-8988-7657c5eec4f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:30.773481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-831f1a5e-e4a4-49ae-8988-7657c5eec4f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:30.788991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-831f1a5e-e4a4-49ae-8988-7657c5eec4f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:30.789526 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-831f1a5e-e4a4-49ae-8988-7657c5eec4f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:30.790535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-831f1a5e-e4a4-49ae-8988-7657c5eec4f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:30.791025 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-831f1a5e-e4a4-49ae-8988-7657c5eec4f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:31.018930 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-831f1a5e-e4a4-49ae-8988-7657c5eec4f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:31.028641 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-831f1a5e-e4a4-49ae-8988-7657c5eec4f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:31.030404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-831f1a5e-e4a4-49ae-8988-7657c5eec4f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:31.031621 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-831f1a5e-e4a4-49ae-8988-7657c5eec4f5 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.262911 Feb 17 03:38:31.032180 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 658/1302] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:30 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:32.054780 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8176ccff-781a-47f0-83c8-b5239a101c68 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:32.055441 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8176ccff-781a-47f0-83c8-b5239a101c68 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:32.063414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8176ccff-781a-47f0-83c8-b5239a101c68 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:32.063921 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8176ccff-781a-47f0-83c8-b5239a101c68 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:32.065404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8176ccff-781a-47f0-83c8-b5239a101c68 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:32.065895 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8176ccff-781a-47f0-83c8-b5239a101c68 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:32.279407 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8176ccff-781a-47f0-83c8-b5239a101c68 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:32.289497 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8176ccff-781a-47f0-83c8-b5239a101c68 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:32.291103 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8176ccff-781a-47f0-83c8-b5239a101c68 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:32.292291 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8176ccff-781a-47f0-83c8-b5239a101c68 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.241688 Feb 17 03:38:32.292877 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 645/1303] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:32 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:33.312248 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-69170269-3d02-4fbd-bafd-d18d1b5e9c90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:33.312918 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-69170269-3d02-4fbd-bafd-d18d1b5e9c90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:33.322090 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-69170269-3d02-4fbd-bafd-d18d1b5e9c90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:33.322602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-69170269-3d02-4fbd-bafd-d18d1b5e9c90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:33.323507 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-69170269-3d02-4fbd-bafd-d18d1b5e9c90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:33.324014 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-69170269-3d02-4fbd-bafd-d18d1b5e9c90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:33.431167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-89cac346-f5c9-40b3-bc25-1a7fcdc29876 req-f93e9a8c-4e2c-40d4-9414-84a90bc59e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb13b0aa-8bce-4878-943d-e3483a430b36", "name": "network-vif-plugged", "status": "completed", "tag": "3536cbed-2c8d-4d95-bbc0-f2840e848748"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:38:33.432924 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:38:33.432924 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:38:33.454660 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-89cac346-f5c9-40b3-bc25-1a7fcdc29876 req-f93e9a8c-4e2c-40d4-9414-84a90bc59e82 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:33.455388 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-89cac346-f5c9-40b3-bc25-1a7fcdc29876 req-f93e9a8c-4e2c-40d4-9414-84a90bc59e82 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:33.473979 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-89cac346-f5c9-40b3-bc25-1a7fcdc29876 req-f93e9a8c-4e2c-40d4-9414-84a90bc59e82 service nova] Creating event network-vif-plugged:3536cbed-2c8d-4d95-bbc0-f2840e848748 for instance eb13b0aa-8bce-4878-943d-e3483a430b36 on hv-cinder-75994 Feb 17 03:38:33.479169 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-89cac346-f5c9-40b3-bc25-1a7fcdc29876 req-f93e9a8c-4e2c-40d4-9414-84a90bc59e82 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111855 Feb 17 03:38:33.479993 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 646/1304] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:38:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:38:33.571577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-69170269-3d02-4fbd-bafd-d18d1b5e9c90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:33.582204 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-69170269-3d02-4fbd-bafd-d18d1b5e9c90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:33.583766 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-69170269-3d02-4fbd-bafd-d18d1b5e9c90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:33.584973 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-69170269-3d02-4fbd-bafd-d18d1b5e9c90 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.276827 Feb 17 03:38:33.585625 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 659/1305] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:33 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:34.605396 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-000907d3-0e92-47e0-a221-c58759570e7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:34.606292 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-000907d3-0e92-47e0-a221-c58759570e7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:34.615381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-000907d3-0e92-47e0-a221-c58759570e7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:34.615818 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-000907d3-0e92-47e0-a221-c58759570e7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:34.616661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-000907d3-0e92-47e0-a221-c58759570e7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:34.617171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-000907d3-0e92-47e0-a221-c58759570e7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:34.838297 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-000907d3-0e92-47e0-a221-c58759570e7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:34.848784 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-000907d3-0e92-47e0-a221-c58759570e7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:34.850427 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-000907d3-0e92-47e0-a221-c58759570e7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:34.851640 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-000907d3-0e92-47e0-a221-c58759570e7d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.251532 Feb 17 03:38:34.852416 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 647/1306] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:34 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:35.870788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d0d9a24d-aded-4c68-b1d4-6e4d60f1d052 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:35.871481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d0d9a24d-aded-4c68-b1d4-6e4d60f1d052 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:35.880599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d0d9a24d-aded-4c68-b1d4-6e4d60f1d052 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:35.881129 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d0d9a24d-aded-4c68-b1d4-6e4d60f1d052 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:35.881984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d0d9a24d-aded-4c68-b1d4-6e4d60f1d052 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:35.882479 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d0d9a24d-aded-4c68-b1d4-6e4d60f1d052 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:36.095238 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d0d9a24d-aded-4c68-b1d4-6e4d60f1d052 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:36.105392 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d0d9a24d-aded-4c68-b1d4-6e4d60f1d052 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:36.107305 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d0d9a24d-aded-4c68-b1d4-6e4d60f1d052 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:36.109083 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d0d9a24d-aded-4c68-b1d4-6e4d60f1d052 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.241858 Feb 17 03:38:36.109172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 660/1307] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:35 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:37.128847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f7604dd7-22ab-4322-999c-3cfcd63a514d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:37.129540 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f7604dd7-22ab-4322-999c-3cfcd63a514d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:37.137462 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7604dd7-22ab-4322-999c-3cfcd63a514d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:37.137968 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7604dd7-22ab-4322-999c-3cfcd63a514d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:37.138835 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7604dd7-22ab-4322-999c-3cfcd63a514d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:37.139299 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7604dd7-22ab-4322-999c-3cfcd63a514d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:37.355068 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f7604dd7-22ab-4322-999c-3cfcd63a514d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:37.365171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f7604dd7-22ab-4322-999c-3cfcd63a514d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:37.366782 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f7604dd7-22ab-4322-999c-3cfcd63a514d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:37.367986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f7604dd7-22ab-4322-999c-3cfcd63a514d tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1730 microversion: 2.20 time: 0.243914 Feb 17 03:38:37.368575 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 648/1308] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:37 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1730 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:38:38.172787 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cf24342c-f106-42c7-9cba-245ecab2b592 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1200430066", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-461955903", "security_groups": [{"name": "tempest-TestVolumeBootPattern-107357108"}], "block_device_mapping_v2": [{"uuid": "c3a35fd3-614c-4a86-a107-7e2e89fccf39", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3cb0cdf3-e2d2-4fae-b226-b086c7cc05ee"}]}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:38:38.296813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-dd11893f-922d-43d3-821a-d96c10c97424 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:38.297955 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-dd11893f-922d-43d3-821a-d96c10c97424 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:38.306534 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dd11893f-922d-43d3-821a-d96c10c97424 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:38.307024 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dd11893f-922d-43d3-821a-d96c10c97424 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:38.307897 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dd11893f-922d-43d3-821a-d96c10c97424 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:38.308405 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dd11893f-922d-43d3-821a-d96c10c97424 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:38.379404 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-dd11893f-922d-43d3-821a-d96c10c97424 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087203 Feb 17 03:38:38.380214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 649/1309] 10.222.0.57 () {58 vars in 1292 bytes} [Wed Feb 17 03:38:38 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:38:38.388860 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-34ea084e-8fca-4aa2-98d6-0b3585638ea4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:38.389562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-34ea084e-8fca-4aa2-98d6-0b3585638ea4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:38.397786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34ea084e-8fca-4aa2-98d6-0b3585638ea4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:38.398301 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34ea084e-8fca-4aa2-98d6-0b3585638ea4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:38.399130 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34ea084e-8fca-4aa2-98d6-0b3585638ea4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:38.399621 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-34ea084e-8fca-4aa2-98d6-0b3585638ea4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:38.462175 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-cf24342c-f106-42c7-9cba-245ecab2b592 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] validate_networks() for [('3cb0cdf3-e2d2-4fae-b226-b086c7cc05ee', None, None, None)] {{(pid=98104) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:38:38.614198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-34ea084e-8fca-4aa2-98d6-0b3585638ea4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:38.623492 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-34ea084e-8fca-4aa2-98d6-0b3585638ea4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:38.625094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-34ea084e-8fca-4aa2-98d6-0b3585638ea4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:38.626280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-34ea084e-8fca-4aa2-98d6-0b3585638ea4 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1717 microversion: 2.20 time: 0.242887 Feb 17 03:38:38.626912 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 650/1310] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:38:38 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1717 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 17 03:38:38.632482 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ad755c05-7c89-41ba-817e-35ac8f4128df tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:38.633016 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ad755c05-7c89-41ba-817e-35ac8f4128df tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:38.640649 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad755c05-7c89-41ba-817e-35ac8f4128df tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:38.641195 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad755c05-7c89-41ba-817e-35ac8f4128df tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:38.642034 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad755c05-7c89-41ba-817e-35ac8f4128df tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:38.642565 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad755c05-7c89-41ba-817e-35ac8f4128df tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:38.711833 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ad755c05-7c89-41ba-817e-35ac8f4128df tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-volume_attachments/00363622-cf61-4a18-b07a-4022b12ea8d4" status: 200 len: 194 microversion: 2.1 time: 0.083068 Feb 17 03:38:38.712527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 651/1311] 10.222.0.57 () {58 vars in 1403 bytes} [Wed Feb 17 03:38:38 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-volume_attachments/00363622-cf61-4a18-b07a-4022b12ea8d4 => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:38:39.160498 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-cf24342c-f106-42c7-9cba-245ecab2b592 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Flavor limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:38:39.160968 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-cf24342c-f106-42c7-9cba-245ecab2b592 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Image limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:38:39.161585 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-cf24342c-f106-42c7-9cba-245ecab2b592 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Flavor pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:38:39.162041 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-cf24342c-f106-42c7-9cba-245ecab2b592 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Image pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:38:39.162504 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-cf24342c-f106-42c7-9cba-245ecab2b592 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:38:39.172074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cf24342c-f106-42c7-9cba-245ecab2b592 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:39.172559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cf24342c-f106-42c7-9cba-245ecab2b592 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:39.173666 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cf24342c-f106-42c7-9cba-245ecab2b592 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:39.174797 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cf24342c-f106-42c7-9cba-245ecab2b592 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:39.194354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-cf24342c-f106-42c7-9cba-245ecab2b592 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Getting quotas for project 09f977ccc1e54aa6bfffd127c9a4be7d. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:38:39.198976 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-cf24342c-f106-42c7-9cba-245ecab2b592 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Getting quotas for user 1c16fada80664e0cb2bc0031171b6c04 and project 09f977ccc1e54aa6bfffd127c9a4be7d. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:38:39.308775 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cf24342c-f106-42c7-9cba-245ecab2b592 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Going to run 1 instances... {{(pid=98104) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:38:39.311220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cf24342c-f106-42c7-9cba-245ecab2b592 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c3a35fd3-614c-4a86-a107-7e2e89fccf39',volume_size=None,volume_type=None)] {{(pid=98104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:38:39.487935 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cf24342c-f106-42c7-9cba-245ecab2b592 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 412 microversion: 2.1 time: 1.319006 Feb 17 03:38:39.488648 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 661/1312] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:38:38 2021] POST /compute/v2.1/servers => generated 412 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:38:39.499846 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-73a628e6-673f-4732-a624-da9cf0591ffe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:39.500522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-73a628e6-673f-4732-a624-da9cf0591ffe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:39.579702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-73a628e6-673f-4732-a624-da9cf0591ffe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:39.588704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-73a628e6-673f-4732-a624-da9cf0591ffe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1094 microversion: 2.1 time: 0.092957 Feb 17 03:38:39.589311 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 652/1313] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:39 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1094 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:40.323271 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a1f4cc1a-d573-42c5-b7fe-8941620dbe25 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ca1c111-8547-4eb2-8d60-d24734da56e3"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:38:40.324582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a1f4cc1a-d573-42c5-b7fe-8941620dbe25 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:40.333879 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1f4cc1a-d573-42c5-b7fe-8941620dbe25 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:40.334385 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1f4cc1a-d573-42c5-b7fe-8941620dbe25 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:40.335247 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1f4cc1a-d573-42c5-b7fe-8941620dbe25 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:40.335740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a1f4cc1a-d573-42c5-b7fe-8941620dbe25 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:40.607347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-744220d2-f485-4d9b-97e6-231d7b937dfe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:40.608025 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-744220d2-f485-4d9b-97e6-231d7b937dfe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:40.618491 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-744220d2-f485-4d9b-97e6-231d7b937dfe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:40.618678 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-744220d2-f485-4d9b-97e6-231d7b937dfe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:40.619440 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-744220d2-f485-4d9b-97e6-231d7b937dfe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:40.620002 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-744220d2-f485-4d9b-97e6-231d7b937dfe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:40.731569 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a1f4cc1a-d573-42c5-b7fe-8941620dbe25 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412581 Feb 17 03:38:40.733197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 662/1314] 10.222.0.57 () {60 vars in 1313 bytes} [Wed Feb 17 03:38:40 2021] POST /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-volume_attachments => generated 194 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:38:40.747863 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-744220d2-f485-4d9b-97e6-231d7b937dfe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:40.762529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-744220d2-f485-4d9b-97e6-231d7b937dfe tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1144 microversion: 2.1 time: 0.158812 Feb 17 03:38:40.763402 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 653/1315] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:40 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1144 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:41.782965 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-76b5ef6c-016d-4168-b011-f3506a90c600 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:41.784414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-76b5ef6c-016d-4168-b011-f3506a90c600 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:41.793930 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-76b5ef6c-016d-4168-b011-f3506a90c600 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:41.794445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-76b5ef6c-016d-4168-b011-f3506a90c600 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:41.795291 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-76b5ef6c-016d-4168-b011-f3506a90c600 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:41.795788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-76b5ef6c-016d-4168-b011-f3506a90c600 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:41.958228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-76b5ef6c-016d-4168-b011-f3506a90c600 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:41.969864 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-76b5ef6c-016d-4168-b011-f3506a90c600 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1200 microversion: 2.1 time: 0.191515 Feb 17 03:38:41.980486 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 663/1316] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:41 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1200 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:42.989936 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e52fd882-707b-4850-9588-59c0faa24260 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:42.990618 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e52fd882-707b-4850-9588-59c0faa24260 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:42.999311 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e52fd882-707b-4850-9588-59c0faa24260 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:42.999825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e52fd882-707b-4850-9588-59c0faa24260 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:43.000779 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e52fd882-707b-4850-9588-59c0faa24260 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:43.001303 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e52fd882-707b-4850-9588-59c0faa24260 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:43.227435 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e52fd882-707b-4850-9588-59c0faa24260 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:43.237092 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e52fd882-707b-4850-9588-59c0faa24260 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1284 microversion: 2.1 time: 0.251305 Feb 17 03:38:43.237698 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 654/1317] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:42 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1284 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:44.256307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-da066970-4bc2-4777-95ce-fedd7e284575 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:44.257122 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-da066970-4bc2-4777-95ce-fedd7e284575 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:44.266009 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da066970-4bc2-4777-95ce-fedd7e284575 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:44.266619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da066970-4bc2-4777-95ce-fedd7e284575 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:44.267552 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da066970-4bc2-4777-95ce-fedd7e284575 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:44.268760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-da066970-4bc2-4777-95ce-fedd7e284575 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:44.741530 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-da066970-4bc2-4777-95ce-fedd7e284575 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:44.751165 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-da066970-4bc2-4777-95ce-fedd7e284575 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1284 microversion: 2.1 time: 0.499566 Feb 17 03:38:44.752183 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 664/1318] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:44 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1284 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:44.820935 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-4b03ab6c-ce73-490e-901c-d05e731449e9 req-64c6063a-c8c9-4bc2-81d3-a579b81fe6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f8f18c7-f615-4522-86f3-7d9caae10cb0", "tag": "3b32b96c-a86d-446f-8f9f-4f8b2c500fb9"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:38:44.823041 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:38:44.823041 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:38:44.833286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-4b03ab6c-ce73-490e-901c-d05e731449e9 req-64c6063a-c8c9-4bc2-81d3-a579b81fe6c4 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:44.833892 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-4b03ab6c-ce73-490e-901c-d05e731449e9 req-64c6063a-c8c9-4bc2-81d3-a579b81fe6c4 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:44.869623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-4b03ab6c-ce73-490e-901c-d05e731449e9 req-64c6063a-c8c9-4bc2-81d3-a579b81fe6c4 service nova] Creating event network-changed:3b32b96c-a86d-446f-8f9f-4f8b2c500fb9 for instance 1f8f18c7-f615-4522-86f3-7d9caae10cb0 on hv-cinder-75994 Feb 17 03:38:44.875702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-4b03ab6c-ce73-490e-901c-d05e731449e9 req-64c6063a-c8c9-4bc2-81d3-a579b81fe6c4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127032 Feb 17 03:38:44.876963 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 655/1319] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:38:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:38:45.769321 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0b55c045-20cd-401c-8887-89e8c2e6bcb6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:45.770028 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0b55c045-20cd-401c-8887-89e8c2e6bcb6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:45.778120 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0b55c045-20cd-401c-8887-89e8c2e6bcb6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:45.778623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0b55c045-20cd-401c-8887-89e8c2e6bcb6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:45.779464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0b55c045-20cd-401c-8887-89e8c2e6bcb6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:45.779959 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0b55c045-20cd-401c-8887-89e8c2e6bcb6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:46.106457 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0b55c045-20cd-401c-8887-89e8c2e6bcb6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:46.115657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0b55c045-20cd-401c-8887-89e8c2e6bcb6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1284 microversion: 2.1 time: 0.350475 Feb 17 03:38:46.116264 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 665/1320] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:45 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1284 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:47.134240 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1c854c42-7187-470f-839b-2d7923055772 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:47.134999 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1c854c42-7187-470f-839b-2d7923055772 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:47.143248 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1c854c42-7187-470f-839b-2d7923055772 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:47.143631 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1c854c42-7187-470f-839b-2d7923055772 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:47.144464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1c854c42-7187-470f-839b-2d7923055772 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:47.144954 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1c854c42-7187-470f-839b-2d7923055772 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:47.357170 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1c854c42-7187-470f-839b-2d7923055772 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:47.366465 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1c854c42-7187-470f-839b-2d7923055772 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1284 microversion: 2.1 time: 0.236734 Feb 17 03:38:47.367060 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 656/1321] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:47 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1284 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:48.386037 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c589e1ed-6dbd-46e0-8e25-21f03f3a0cad tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:48.386949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c589e1ed-6dbd-46e0-8e25-21f03f3a0cad tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:48.398205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c589e1ed-6dbd-46e0-8e25-21f03f3a0cad tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:48.398719 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c589e1ed-6dbd-46e0-8e25-21f03f3a0cad tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:48.400075 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c589e1ed-6dbd-46e0-8e25-21f03f3a0cad tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:48.400751 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c589e1ed-6dbd-46e0-8e25-21f03f3a0cad tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:48.626399 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c589e1ed-6dbd-46e0-8e25-21f03f3a0cad tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:48.636123 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c589e1ed-6dbd-46e0-8e25-21f03f3a0cad tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1284 microversion: 2.1 time: 0.255004 Feb 17 03:38:48.636737 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 666/1322] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:48 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1284 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:48.639197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-490b17ab-b8e0-4866-a9b1-528cb99163cd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:48.640252 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-490b17ab-b8e0-4866-a9b1-528cb99163cd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:48.648932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-490b17ab-b8e0-4866-a9b1-528cb99163cd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:48.649470 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-490b17ab-b8e0-4866-a9b1-528cb99163cd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:48.650558 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-490b17ab-b8e0-4866-a9b1-528cb99163cd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:48.651061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-490b17ab-b8e0-4866-a9b1-528cb99163cd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:48.720904 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-490b17ab-b8e0-4866-a9b1-528cb99163cd tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.085651 Feb 17 03:38:48.721478 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 657/1323] 10.222.0.57 () {58 vars in 1292 bytes} [Wed Feb 17 03:38:48 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-volume_attachments => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:38:48.992894 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c5a20e4b-0567-47fa-8f5e-d3f68127c13c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:48.993472 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c5a20e4b-0567-47fa-8f5e-d3f68127c13c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:49.001510 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c5a20e4b-0567-47fa-8f5e-d3f68127c13c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:49.002018 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c5a20e4b-0567-47fa-8f5e-d3f68127c13c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:49.002851 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c5a20e4b-0567-47fa-8f5e-d3f68127c13c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:49.003368 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c5a20e4b-0567-47fa-8f5e-d3f68127c13c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:49.073403 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c5a20e4b-0567-47fa-8f5e-d3f68127c13c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-volume_attachments/00363622-cf61-4a18-b07a-4022b12ea8d4" status: 200 len: 194 microversion: 2.1 time: 0.085243 Feb 17 03:38:49.074055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 667/1324] 10.222.0.57 () {58 vars in 1403 bytes} [Wed Feb 17 03:38:48 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-volume_attachments/00363622-cf61-4a18-b07a-4022b12ea8d4 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:38:49.084647 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8276a530-a8e4-40b0-8cba-f13e981bdd8a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:49.085222 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8276a530-a8e4-40b0-8cba-f13e981bdd8a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:49.093072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8276a530-a8e4-40b0-8cba-f13e981bdd8a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:49.093597 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8276a530-a8e4-40b0-8cba-f13e981bdd8a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:49.094437 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8276a530-a8e4-40b0-8cba-f13e981bdd8a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:49.094927 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8276a530-a8e4-40b0-8cba-f13e981bdd8a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:49.274403 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-8276a530-a8e4-40b0-8cba-f13e981bdd8a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lazy-loading 'services' on Instance uuid 94dff4c9-58ab-474c-97ba-cb0bcea04ac9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:38:49.421779 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8276a530-a8e4-40b0-8cba-f13e981bdd8a tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "DELETE /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-volume_attachments/00363622-cf61-4a18-b07a-4022b12ea8d4" status: 202 len: 0 microversion: 2.1 time: 0.340999 Feb 17 03:38:49.422421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 658/1325] 10.222.0.57 () {58 vars in 1406 bytes} [Wed Feb 17 03:38:49 2021] DELETE /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-volume_attachments/00363622-cf61-4a18-b07a-4022b12ea8d4 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:38:49.654348 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cb73d90c-2842-4a2f-a593-0aaa808a94fd tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:49.655630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cb73d90c-2842-4a2f-a593-0aaa808a94fd tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:49.664825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cb73d90c-2842-4a2f-a593-0aaa808a94fd tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:49.665366 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cb73d90c-2842-4a2f-a593-0aaa808a94fd tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:49.666246 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cb73d90c-2842-4a2f-a593-0aaa808a94fd tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:49.666716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cb73d90c-2842-4a2f-a593-0aaa808a94fd tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:49.883600 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-cb73d90c-2842-4a2f-a593-0aaa808a94fd tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:49.892615 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cb73d90c-2842-4a2f-a593-0aaa808a94fd tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1272 microversion: 2.1 time: 0.242421 Feb 17 03:38:49.894599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 668/1326] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:49 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1272 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:50.913328 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-327ab9bb-9d99-4214-a7bb-76cc94433288 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:50.914100 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-327ab9bb-9d99-4214-a7bb-76cc94433288 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:50.922369 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-327ab9bb-9d99-4214-a7bb-76cc94433288 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:50.922883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-327ab9bb-9d99-4214-a7bb-76cc94433288 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:50.923733 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-327ab9bb-9d99-4214-a7bb-76cc94433288 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:50.924221 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-327ab9bb-9d99-4214-a7bb-76cc94433288 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:51.141689 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-327ab9bb-9d99-4214-a7bb-76cc94433288 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:51.151981 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-327ab9bb-9d99-4214-a7bb-76cc94433288 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1272 microversion: 2.1 time: 0.243443 Feb 17 03:38:51.152515 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 659/1327] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:50 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1272 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:51.732275 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b15eda0a-38c4-419f-8882-c2866a9c8957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:51.732816 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b15eda0a-38c4-419f-8882-c2866a9c8957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:51.740596 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b15eda0a-38c4-419f-8882-c2866a9c8957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:51.741149 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b15eda0a-38c4-419f-8882-c2866a9c8957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:51.741989 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b15eda0a-38c4-419f-8882-c2866a9c8957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:51.742474 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b15eda0a-38c4-419f-8882-c2866a9c8957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:51.813285 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b15eda0a-38c4-419f-8882-c2866a9c8957 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-volume_attachments/8ca1c111-8547-4eb2-8d60-d24734da56e3" status: 200 len: 194 microversion: 2.1 time: 0.085050 Feb 17 03:38:51.813927 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 669/1328] 10.222.0.57 () {58 vars in 1403 bytes} [Wed Feb 17 03:38:51 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-volume_attachments/8ca1c111-8547-4eb2-8d60-d24734da56e3 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:38:51.824932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-88e3cad2-1ac3-4965-9320-c0e1e5c17b8b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:51.825568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-88e3cad2-1ac3-4965-9320-c0e1e5c17b8b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:51.833873 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-88e3cad2-1ac3-4965-9320-c0e1e5c17b8b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:51.834378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-88e3cad2-1ac3-4965-9320-c0e1e5c17b8b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:51.835207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-88e3cad2-1ac3-4965-9320-c0e1e5c17b8b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:51.835695 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-88e3cad2-1ac3-4965-9320-c0e1e5c17b8b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:52.013858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-88e3cad2-1ac3-4965-9320-c0e1e5c17b8b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lazy-loading 'services' on Instance uuid 94dff4c9-58ab-474c-97ba-cb0bcea04ac9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:38:52.159596 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-88e3cad2-1ac3-4965-9320-c0e1e5c17b8b tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "DELETE /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-volume_attachments/8ca1c111-8547-4eb2-8d60-d24734da56e3" status: 202 len: 0 microversion: 2.1 time: 0.338722 Feb 17 03:38:52.160138 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 660/1329] 10.222.0.57 () {58 vars in 1406 bytes} [Wed Feb 17 03:38:51 2021] DELETE /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9/os-volume_attachments/8ca1c111-8547-4eb2-8d60-d24734da56e3 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:38:52.170799 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2f8d270a-1904-4209-8389-bd690e062b8c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:52.171462 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2f8d270a-1904-4209-8389-bd690e062b8c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:52.179478 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2f8d270a-1904-4209-8389-bd690e062b8c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:52.179985 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2f8d270a-1904-4209-8389-bd690e062b8c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:52.180830 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2f8d270a-1904-4209-8389-bd690e062b8c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:52.181360 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2f8d270a-1904-4209-8389-bd690e062b8c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:52.397899 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2f8d270a-1904-4209-8389-bd690e062b8c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:52.407222 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2f8d270a-1904-4209-8389-bd690e062b8c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1272 microversion: 2.1 time: 0.240613 Feb 17 03:38:52.407822 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 670/1330] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:52 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1272 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:53.427630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-adaecef6-84ce-41cc-abe6-b0255f2693e3 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:53.428412 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-adaecef6-84ce-41cc-abe6-b0255f2693e3 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:53.437504 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-adaecef6-84ce-41cc-abe6-b0255f2693e3 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:53.438114 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-adaecef6-84ce-41cc-abe6-b0255f2693e3 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:53.439001 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-adaecef6-84ce-41cc-abe6-b0255f2693e3 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:53.439492 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-adaecef6-84ce-41cc-abe6-b0255f2693e3 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:53.684086 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-adaecef6-84ce-41cc-abe6-b0255f2693e3 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:53.694014 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-adaecef6-84ce-41cc-abe6-b0255f2693e3 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1272 microversion: 2.1 time: 0.272458 Feb 17 03:38:53.694805 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 661/1331] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:53 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1272 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:53.783315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7f425751-d398-4a5c-be78-5e49fe136f74 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:53.783874 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7f425751-d398-4a5c-be78-5e49fe136f74 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:53.793172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f425751-d398-4a5c-be78-5e49fe136f74 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:53.793621 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f425751-d398-4a5c-be78-5e49fe136f74 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:53.794468 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f425751-d398-4a5c-be78-5e49fe136f74 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:53.794970 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7f425751-d398-4a5c-be78-5e49fe136f74 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:53.865792 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7f425751-d398-4a5c-be78-5e49fe136f74 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Going to try to terminate instance {{(pid=98104) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:38:53.988475 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7f425751-d398-4a5c-be78-5e49fe136f74 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "DELETE /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 204 len: 0 microversion: 2.1 time: 0.208822 Feb 17 03:38:53.989177 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 671/1332] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:38:53 2021] DELETE /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:38:53.998075 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6724d885-ded0-4ade-9917-0076cbe191a9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:53.999627 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6724d885-ded0-4ade-9917-0076cbe191a9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:54.008195 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6724d885-ded0-4ade-9917-0076cbe191a9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:54.008707 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6724d885-ded0-4ade-9917-0076cbe191a9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:54.009602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6724d885-ded0-4ade-9917-0076cbe191a9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:54.010102 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6724d885-ded0-4ade-9917-0076cbe191a9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:54.236486 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6724d885-ded0-4ade-9917-0076cbe191a9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:54.246306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6724d885-ded0-4ade-9917-0076cbe191a9 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 200 len: 1673 microversion: 2.1 time: 0.252310 Feb 17 03:38:54.246906 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 662/1333] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:53 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 1673 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:54.714527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1789f952-4cd3-4d38-af78-2c9c06d7e5b1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:54.715445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1789f952-4cd3-4d38-af78-2c9c06d7e5b1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:54.723507 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1789f952-4cd3-4d38-af78-2c9c06d7e5b1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:54.724011 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1789f952-4cd3-4d38-af78-2c9c06d7e5b1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:54.724856 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1789f952-4cd3-4d38-af78-2c9c06d7e5b1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:54.725370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1789f952-4cd3-4d38-af78-2c9c06d7e5b1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:54.946148 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1789f952-4cd3-4d38-af78-2c9c06d7e5b1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:54.955329 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1789f952-4cd3-4d38-af78-2c9c06d7e5b1 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1272 microversion: 2.1 time: 0.245362 Feb 17 03:38:54.955933 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 672/1334] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:54 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:55.264280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1e8b71e8-df34-43cc-b69b-560a76f91629 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:55.264976 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1e8b71e8-df34-43cc-b69b-560a76f91629 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:55.273185 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e8b71e8-df34-43cc-b69b-560a76f91629 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:55.273688 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e8b71e8-df34-43cc-b69b-560a76f91629 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:55.274519 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e8b71e8-df34-43cc-b69b-560a76f91629 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:55.275004 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e8b71e8-df34-43cc-b69b-560a76f91629 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:55.493306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1e8b71e8-df34-43cc-b69b-560a76f91629 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:55.505747 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1e8b71e8-df34-43cc-b69b-560a76f91629 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 200 len: 1673 microversion: 2.1 time: 0.245340 Feb 17 03:38:55.506356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 663/1335] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:55 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 1673 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:55.973183 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8d7f33d7-55cf-4e54-ba1e-021ad3a5d561 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:55.973895 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8d7f33d7-55cf-4e54-ba1e-021ad3a5d561 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:55.981727 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8d7f33d7-55cf-4e54-ba1e-021ad3a5d561 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:55.982241 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8d7f33d7-55cf-4e54-ba1e-021ad3a5d561 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:55.983122 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8d7f33d7-55cf-4e54-ba1e-021ad3a5d561 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:55.983676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8d7f33d7-55cf-4e54-ba1e-021ad3a5d561 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:56.191888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8d7f33d7-55cf-4e54-ba1e-021ad3a5d561 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:56.201843 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8d7f33d7-55cf-4e54-ba1e-021ad3a5d561 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1272 microversion: 2.1 time: 0.232687 Feb 17 03:38:56.202899 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 673/1336] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:55 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1272 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:56.525144 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9f8006e6-ae71-4969-acff-ba718b421e0c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:56.525809 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9f8006e6-ae71-4969-acff-ba718b421e0c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:56.533749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9f8006e6-ae71-4969-acff-ba718b421e0c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:56.534251 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9f8006e6-ae71-4969-acff-ba718b421e0c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:56.535075 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9f8006e6-ae71-4969-acff-ba718b421e0c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:56.535558 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9f8006e6-ae71-4969-acff-ba718b421e0c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:56.754211 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9f8006e6-ae71-4969-acff-ba718b421e0c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:56.764729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9f8006e6-ae71-4969-acff-ba718b421e0c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 200 len: 1673 microversion: 2.1 time: 0.244246 Feb 17 03:38:56.765825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 664/1337] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:56 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 1673 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:57.220465 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ac7180f6-7af4-4d69-9acd-54dca87c59e9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:57.221151 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ac7180f6-7af4-4d69-9acd-54dca87c59e9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:57.230612 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac7180f6-7af4-4d69-9acd-54dca87c59e9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:57.231119 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac7180f6-7af4-4d69-9acd-54dca87c59e9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:57.232035 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac7180f6-7af4-4d69-9acd-54dca87c59e9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:57.232731 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac7180f6-7af4-4d69-9acd-54dca87c59e9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:57.651617 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ac7180f6-7af4-4d69-9acd-54dca87c59e9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:57.660722 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ac7180f6-7af4-4d69-9acd-54dca87c59e9 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1272 microversion: 2.1 time: 0.444531 Feb 17 03:38:57.661984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 674/1338] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:57 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1272 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:57.790142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c47c196a-0429-4ad1-bf9d-ab88b1721f06 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:57.791241 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c47c196a-0429-4ad1-bf9d-ab88b1721f06 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:57.806786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c47c196a-0429-4ad1-bf9d-ab88b1721f06 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:57.807691 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c47c196a-0429-4ad1-bf9d-ab88b1721f06 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:57.809296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c47c196a-0429-4ad1-bf9d-ab88b1721f06 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:57.810200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c47c196a-0429-4ad1-bf9d-ab88b1721f06 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:58.059114 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c47c196a-0429-4ad1-bf9d-ab88b1721f06 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:58.068608 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c47c196a-0429-4ad1-bf9d-ab88b1721f06 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 200 len: 1673 microversion: 2.1 time: 0.286663 Feb 17 03:38:58.069262 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 665/1339] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:57 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 1673 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:58.686972 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ca1cdb2e-dcd9-4228-be01-a71535338adf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:58.687644 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ca1cdb2e-dcd9-4228-be01-a71535338adf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:58.696184 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca1cdb2e-dcd9-4228-be01-a71535338adf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:58.696695 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca1cdb2e-dcd9-4228-be01-a71535338adf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:58.697852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca1cdb2e-dcd9-4228-be01-a71535338adf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:58.698348 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ca1cdb2e-dcd9-4228-be01-a71535338adf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:59.075130 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-be7af190-9328-4c3d-8014-bcf59362656f req-eed58024-be64-42e4-9f31-68cb8d9a06bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94dff4c9-58ab-474c-97ba-cb0bcea04ac9", "name": "network-vif-deleted", "tag": "69a3d64d-ffe3-4aa5-aaf3-41565f3dd68c"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:38:59.076878 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:38:59.076878 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:38:59.092917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-be7af190-9328-4c3d-8014-bcf59362656f req-eed58024-be64-42e4-9f31-68cb8d9a06bd service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:59.094027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-be7af190-9328-4c3d-8014-bcf59362656f req-eed58024-be64-42e4-9f31-68cb8d9a06bd service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:59.115685 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ca1cdb2e-dcd9-4228-be01-a71535338adf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:59.126384 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ca1cdb2e-dcd9-4228-be01-a71535338adf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1272 microversion: 2.1 time: 0.443382 Feb 17 03:38:59.128230 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-be7af190-9328-4c3d-8014-bcf59362656f req-eed58024-be64-42e4-9f31-68cb8d9a06bd service nova] Creating event network-vif-deleted:69a3d64d-ffe3-4aa5-aaf3-41565f3dd68c for instance 94dff4c9-58ab-474c-97ba-cb0bcea04ac9 on hv-cinder-75994 Feb 17 03:38:59.135548 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 675/1340] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:58 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1272 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:38:59.141718 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-82a3997f-56bf-46c5-9212-5a90d8b662e3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:38:59.144937 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-be7af190-9328-4c3d-8014-bcf59362656f req-eed58024-be64-42e4-9f31-68cb8d9a06bd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072820 Feb 17 03:38:59.145868 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-82a3997f-56bf-46c5-9212-5a90d8b662e3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:38:59.146456 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 666/1341] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:38:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:38:59.154596 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82a3997f-56bf-46c5-9212-5a90d8b662e3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:59.155109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82a3997f-56bf-46c5-9212-5a90d8b662e3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:59.155978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82a3997f-56bf-46c5-9212-5a90d8b662e3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:38:59.156469 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-82a3997f-56bf-46c5-9212-5a90d8b662e3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:38:59.313520 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-82a3997f-56bf-46c5-9212-5a90d8b662e3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e8201ff554fefa20487ac8f981d07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c568344bec0146c19c14571bff20a759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:38:59.328562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-82a3997f-56bf-46c5-9212-5a90d8b662e3 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 200 len: 1321 microversion: 2.1 time: 0.191582 Feb 17 03:38:59.329884 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 676/1342] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:38:59 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:00.145653 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-33fd3c58-a146-4aed-a0a4-408506c23607 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:00.146336 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-33fd3c58-a146-4aed-a0a4-408506c23607 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:00.154869 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-33fd3c58-a146-4aed-a0a4-408506c23607 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:00.155377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-33fd3c58-a146-4aed-a0a4-408506c23607 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:00.156232 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-33fd3c58-a146-4aed-a0a4-408506c23607 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:00.156722 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-33fd3c58-a146-4aed-a0a4-408506c23607 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:00.350821 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2c34b4f5-5de3-490b-833a-ec688233b74f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:00.351493 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2c34b4f5-5de3-490b-833a-ec688233b74f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:00.360155 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2c34b4f5-5de3-490b-833a-ec688233b74f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:00.360776 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2c34b4f5-5de3-490b-833a-ec688233b74f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:00.361519 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2c34b4f5-5de3-490b-833a-ec688233b74f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:00.362080 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2c34b4f5-5de3-490b-833a-ec688233b74f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:00.378014 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-33fd3c58-a146-4aed-a0a4-408506c23607 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:00.388581 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-33fd3c58-a146-4aed-a0a4-408506c23607 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1272 microversion: 2.1 time: 0.247279 Feb 17 03:39:00.389767 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 667/1343] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:00 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1272 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:00.421446 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-2c34b4f5-5de3-490b-833a-ec688233b74f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] HTTP exception thrown: Instance 94dff4c9-58ab-474c-97ba-cb0bcea04ac9 could not be found. Feb 17 03:39:00.422142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2c34b4f5-5de3-490b-833a-ec688233b74f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Returning 404 to user: Instance 94dff4c9-58ab-474c-97ba-cb0bcea04ac9 could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:39:00.423079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2c34b4f5-5de3-490b-833a-ec688233b74f tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 404 len: 111 microversion: 2.1 time: 0.077068 Feb 17 03:39:00.423908 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 677/1344] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:00 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 03:39:00.433870 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8bb376be-9412-411c-bb10-06f9f50d3c0c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '.version_select at 0x7f98b02c8d90>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:00.455210 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8bb376be-9412-411c-bb10-06f9f50d3c0c tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-102674015" status: 202 len: 0 microversion: 2.1 time: 0.025649 Feb 17 03:39:00.455864 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 668/1345] 10.222.0.57 () {58 vars in 1208 bytes} [Wed Feb 17 03:39:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-102674015 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:39:01.407671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1e17d443-d7ae-427e-90c4-cf0e62a3ef0d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:01.408422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1e17d443-d7ae-427e-90c4-cf0e62a3ef0d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:01.417782 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e17d443-d7ae-427e-90c4-cf0e62a3ef0d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:01.418290 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e17d443-d7ae-427e-90c4-cf0e62a3ef0d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:01.419444 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e17d443-d7ae-427e-90c4-cf0e62a3ef0d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:01.420067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e17d443-d7ae-427e-90c4-cf0e62a3ef0d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:01.658435 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1e17d443-d7ae-427e-90c4-cf0e62a3ef0d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:01.667852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1e17d443-d7ae-427e-90c4-cf0e62a3ef0d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1272 microversion: 2.1 time: 0.264355 Feb 17 03:39:01.668483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 678/1346] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:01 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1272 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:01.701680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-fe95be35-ad6f-4cec-a79a-a6f2d2ac5f55 req-dd0d45c2-d3f9-437e-b2d2-b576af5ce222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f8f18c7-f615-4522-86f3-7d9caae10cb0", "name": "network-vif-plugged", "status": "completed", "tag": "3b32b96c-a86d-446f-8f9f-4f8b2c500fb9"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:39:01.703438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:39:01.703438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:39:01.713650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-fe95be35-ad6f-4cec-a79a-a6f2d2ac5f55 req-dd0d45c2-d3f9-437e-b2d2-b576af5ce222 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:01.714158 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-fe95be35-ad6f-4cec-a79a-a6f2d2ac5f55 req-dd0d45c2-d3f9-437e-b2d2-b576af5ce222 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:01.733073 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-fe95be35-ad6f-4cec-a79a-a6f2d2ac5f55 req-dd0d45c2-d3f9-437e-b2d2-b576af5ce222 service nova] Creating event network-vif-plugged:3b32b96c-a86d-446f-8f9f-4f8b2c500fb9 for instance 1f8f18c7-f615-4522-86f3-7d9caae10cb0 on hv-cinder-75994 Feb 17 03:39:01.738610 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-fe95be35-ad6f-4cec-a79a-a6f2d2ac5f55 req-dd0d45c2-d3f9-437e-b2d2-b576af5ce222 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041370 Feb 17 03:39:01.739826 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 669/1347] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:39:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:39:02.687563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cfaf17b7-d317-455a-a5d0-9f7c1e8305ac tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:02.688213 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cfaf17b7-d317-455a-a5d0-9f7c1e8305ac tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:02.696888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cfaf17b7-d317-455a-a5d0-9f7c1e8305ac tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:02.697709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cfaf17b7-d317-455a-a5d0-9f7c1e8305ac tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:02.698565 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cfaf17b7-d317-455a-a5d0-9f7c1e8305ac tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:02.699055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cfaf17b7-d317-455a-a5d0-9f7c1e8305ac tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:03.049863 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-cfaf17b7-d317-455a-a5d0-9f7c1e8305ac tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:03.060063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cfaf17b7-d317-455a-a5d0-9f7c1e8305ac tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1272 microversion: 2.1 time: 0.377316 Feb 17 03:39:03.060954 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 679/1348] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:02 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1272 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:04.080300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-aca7b18e-70b6-43d8-a4d2-59d0afef79f8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:04.081013 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-aca7b18e-70b6-43d8-a4d2-59d0afef79f8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:04.089376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aca7b18e-70b6-43d8-a4d2-59d0afef79f8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:04.089886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aca7b18e-70b6-43d8-a4d2-59d0afef79f8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:04.090747 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aca7b18e-70b6-43d8-a4d2-59d0afef79f8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:04.091233 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aca7b18e-70b6-43d8-a4d2-59d0afef79f8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:04.313081 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-aca7b18e-70b6-43d8-a4d2-59d0afef79f8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:04.322482 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-aca7b18e-70b6-43d8-a4d2-59d0afef79f8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1459 microversion: 2.1 time: 0.246956 Feb 17 03:39:04.323096 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 670/1349] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:04 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1459 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:04.340436 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-18af1951-e7b6-410f-b0a3-b8bb760d3373 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:04.340939 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-18af1951-e7b6-410f-b0a3-b8bb760d3373 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:04.349490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-18af1951-e7b6-410f-b0a3-b8bb760d3373 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:04.350007 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-18af1951-e7b6-410f-b0a3-b8bb760d3373 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:04.350848 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-18af1951-e7b6-410f-b0a3-b8bb760d3373 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:04.351341 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-18af1951-e7b6-410f-b0a3-b8bb760d3373 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:04.590526 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-18af1951-e7b6-410f-b0a3-b8bb760d3373 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:04.600436 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-18af1951-e7b6-410f-b0a3-b8bb760d3373 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1459 microversion: 2.1 time: 0.264138 Feb 17 03:39:04.601068 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 680/1350] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:04 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1459 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:39:04.619962 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bdab7bdd-d2e7-4193-995a-49d057c6379d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Action: 'create', calling method: .version_select at 0x7f98b02c8bf8>, body: {"pool": null} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:39:05.634184 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b7c9f504-35ca-4463-8191-d5a6b4416db2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:05.634759 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b7c9f504-35ca-4463-8191-d5a6b4416db2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:05.643331 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b7c9f504-35ca-4463-8191-d5a6b4416db2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:05.644066 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b7c9f504-35ca-4463-8191-d5a6b4416db2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:05.645121 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b7c9f504-35ca-4463-8191-d5a6b4416db2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:05.645833 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b7c9f504-35ca-4463-8191-d5a6b4416db2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:05.846597 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-b7c9f504-35ca-4463-8191-d5a6b4416db2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] HTTP exception thrown: Instance 94dff4c9-58ab-474c-97ba-cb0bcea04ac9 could not be found. Feb 17 03:39:05.847180 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b7c9f504-35ca-4463-8191-d5a6b4416db2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Returning 404 to user: Instance 94dff4c9-58ab-474c-97ba-cb0bcea04ac9 could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:39:05.848160 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b7c9f504-35ca-4463-8191-d5a6b4416db2 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "DELETE /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 404 len: 111 microversion: 2.1 time: 0.218086 Feb 17 03:39:05.851616 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 681/1351] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:39:05 2021] DELETE /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:39:05.861555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1e0cecb2-f883-41c7-b373-e59a80a213e7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:05.862373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1e0cecb2-f883-41c7-b373-e59a80a213e7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 94dff4c9-58ab-474c-97ba-cb0bcea04ac9] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:05.872055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e0cecb2-f883-41c7-b373-e59a80a213e7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:05.872567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e0cecb2-f883-41c7-b373-e59a80a213e7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:05.873438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e0cecb2-f883-41c7-b373-e59a80a213e7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:05.873938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1e0cecb2-f883-41c7-b373-e59a80a213e7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:05.928758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-1e0cecb2-f883-41c7-b373-e59a80a213e7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] HTTP exception thrown: Instance 94dff4c9-58ab-474c-97ba-cb0bcea04ac9 could not be found. Feb 17 03:39:05.929454 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1e0cecb2-f883-41c7-b373-e59a80a213e7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Returning 404 to user: Instance 94dff4c9-58ab-474c-97ba-cb0bcea04ac9 could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:39:05.930360 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1e0cecb2-f883-41c7-b373-e59a80a213e7 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9" status: 404 len: 111 microversion: 2.1 time: 0.073643 Feb 17 03:39:05.930980 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 682/1352] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:05 2021] GET /compute/v2.1/servers/94dff4c9-58ab-474c-97ba-cb0bcea04ac9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:39:06.755174 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bdab7bdd-d2e7-4193-995a-49d057c6379d tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.138509 Feb 17 03:39:06.755835 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 671/1353] 10.222.0.57 () {60 vars in 1160 bytes} [Wed Feb 17 03:39:04 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:39:06.768208 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bc39f36c-a377-4443-bee5-254736308a78 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.0.129"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:39:06.769528 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bc39f36c-a377-4443-bee5-254736308a78 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:06.777507 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bc39f36c-a377-4443-bee5-254736308a78 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:06.778017 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bc39f36c-a377-4443-bee5-254736308a78 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:06.778849 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bc39f36c-a377-4443-bee5-254736308a78 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:06.779338 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bc39f36c-a377-4443-bee5-254736308a78 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:06.847301 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bc39f36c-a377-4443-bee5-254736308a78 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Acquired lock "refresh_cache-1f8f18c7-f615-4522-86f3-7d9caae10cb0" {{(pid=98104) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:39:07.191041 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-098d4de5-a41b-4058-bb1a-199fe205ac13 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:07.191607 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-098d4de5-a41b-4058-bb1a-199fe205ac13 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:07.200707 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-098d4de5-a41b-4058-bb1a-199fe205ac13 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:07.201255 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-098d4de5-a41b-4058-bb1a-199fe205ac13 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:07.202113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-098d4de5-a41b-4058-bb1a-199fe205ac13 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:07.202606 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-098d4de5-a41b-4058-bb1a-199fe205ac13 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:07.263228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-098d4de5-a41b-4058-bb1a-199fe205ac13 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] HTTP exception thrown: Instance 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 could not be found. Feb 17 03:39:07.263904 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-098d4de5-a41b-4058-bb1a-199fe205ac13 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Returning 404 to user: Instance 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 could not be found. {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:39:07.264811 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-098d4de5-a41b-4058-bb1a-199fe205ac13 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "DELETE /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 404 len: 111 microversion: 2.1 time: 0.077854 Feb 17 03:39:07.265450 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 672/1354] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:39:07 2021] DELETE /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:39:07.273798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5f55b562-5cdd-4d49-8000-b545b5e4a948 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:07.274472 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5f55b562-5cdd-4d49-8000-b545b5e4a948 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] [instance: 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:07.282233 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f55b562-5cdd-4d49-8000-b545b5e4a948 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:07.282745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f55b562-5cdd-4d49-8000-b545b5e4a948 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:07.283601 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f55b562-5cdd-4d49-8000-b545b5e4a948 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:07.284096 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5f55b562-5cdd-4d49-8000-b545b5e4a948 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:07.338645 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-5f55b562-5cdd-4d49-8000-b545b5e4a948 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] HTTP exception thrown: Instance 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 could not be found. Feb 17 03:39:07.339235 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5f55b562-5cdd-4d49-8000-b545b5e4a948 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] Returning 404 to user: Instance 3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 could not be found. {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:39:07.340149 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5f55b562-5cdd-4d49-8000-b545b5e4a948 tempest-AttachVolumeTestJSON-1098248760 tempest-AttachVolumeTestJSON-1098248760-project] 10.222.0.57 "GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5" status: 404 len: 111 microversion: 2.1 time: 0.070291 Feb 17 03:39:07.340986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 673/1355] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:07 2021] GET /compute/v2.1/servers/3c5a8ede-8248-460e-bef7-6b5c3aaf48f5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 03:39:09.034941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-bc39f36c-a377-4443-bee5-254736308a78 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Building network info cache for instance {{(pid=98104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 03:39:09.046355 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-9acfdd23-1352-4da6-b023-f76d5af9b63c req-0c476754-017f-4727-beb8-327dcb95539a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f8f18c7-f615-4522-86f3-7d9caae10cb0", "tag": "3b32b96c-a86d-446f-8f9f-4f8b2c500fb9"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:39:09.048201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:39:09.048201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:39:09.062103 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-9acfdd23-1352-4da6-b023-f76d5af9b63c req-0c476754-017f-4727-beb8-327dcb95539a service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:09.063413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-9acfdd23-1352-4da6-b023-f76d5af9b63c req-0c476754-017f-4727-beb8-327dcb95539a service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:09.089584 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-9acfdd23-1352-4da6-b023-f76d5af9b63c req-0c476754-017f-4727-beb8-327dcb95539a service nova] Creating event network-changed:3b32b96c-a86d-446f-8f9f-4f8b2c500fb9 for instance 1f8f18c7-f615-4522-86f3-7d9caae10cb0 on hv-cinder-75994 Feb 17 03:39:09.097686 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-9acfdd23-1352-4da6-b023-f76d5af9b63c req-0c476754-017f-4727-beb8-327dcb95539a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055268 Feb 17 03:39:09.099549 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 674/1356] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:39:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:39:10.807042 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-bc39f36c-a377-4443-bee5-254736308a78 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Updating instance_info_cache with network_info: [{"id": "3b32b96c-a86d-446f-8f9f-4f8b2c500fb9", "address": "fa:16:3e:49:63:04", "network": {"id": "3cb0cdf3-e2d2-4fae-b226-b086c7cc05ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1162730446-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "09f977ccc1e54aa6bfffd127c9a4be7d", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap3b32b96c-a8", "ovs_interfaceid": "3b32b96c-a86d-446f-8f9f-4f8b2c500fb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 03:39:10.819662 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bc39f36c-a377-4443-bee5-254736308a78 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Releasing lock "refresh_cache-1f8f18c7-f615-4522-86f3-7d9caae10cb0" {{(pid=98104) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:39:10.823448 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bc39f36c-a377-4443-bee5-254736308a78 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "POST /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0/action" status: 202 len: 0 microversion: 2.1 time: 4.059424 Feb 17 03:39:10.824587 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 683/1357] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:39:06 2021] POST /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0/action => generated 0 bytes in 4061 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 03:39:13.940020 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-aa24098a-c690-4d87-b4f4-9ce025f6b92d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-984020185"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:39:13.943305 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-aa24098a-c690-4d87-b4f4-9ce025f6b92d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:13.952374 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aa24098a-c690-4d87-b4f4-9ce025f6b92d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:13.953288 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aa24098a-c690-4d87-b4f4-9ce025f6b92d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:13.954374 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aa24098a-c690-4d87-b4f4-9ce025f6b92d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:13.955083 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aa24098a-c690-4d87-b4f4-9ce025f6b92d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:14.186307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.network.security_group_api [None req-aa24098a-c690-4d87-b4f4-9ce025f6b92d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Removing security group 58316507-e2b9-47a8-8c80-bbda6482c459 from port 88c76ccb-10fd-4edc-b372-9a3bad57e105 Feb 17 03:39:14.958814 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-aa24098a-c690-4d87-b4f4-9ce025f6b92d tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "POST /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/action" status: 202 len: 0 microversion: 2.1 time: 1.023353 Feb 17 03:39:14.960292 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 675/1358] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:39:13 2021] POST /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/action => generated 0 bytes in 1026 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:39:14.968315 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-447d683c-9519-4bfb-8107-5281d9c0bfba req-b35f17a4-0306-4f95-bd48-3047e39fa5ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307fa9d3-f0a5-4c33-aa27-7271e36ec239", "tag": "88c76ccb-10fd-4edc-b372-9a3bad57e105"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:39:14.968724 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-227c3a15-42e1-4e5a-ad80-767570e6dd18 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '.version_select at 0x7f98b0149950>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:14.972563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:39:14.972563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:39:14.984228 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-447d683c-9519-4bfb-8107-5281d9c0bfba req-b35f17a4-0306-4f95-bd48-3047e39fa5ab service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:14.987039 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-447d683c-9519-4bfb-8107-5281d9c0bfba req-b35f17a4-0306-4f95-bd48-3047e39fa5ab service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:15.017342 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-447d683c-9519-4bfb-8107-5281d9c0bfba req-b35f17a4-0306-4f95-bd48-3047e39fa5ab service nova] Creating event network-changed:88c76ccb-10fd-4edc-b372-9a3bad57e105 for instance 307fa9d3-f0a5-4c33-aa27-7271e36ec239 on hv-cinder-75994 Feb 17 03:39:15.025108 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-447d683c-9519-4bfb-8107-5281d9c0bfba req-b35f17a4-0306-4f95-bd48-3047e39fa5ab service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060091 Feb 17 03:39:15.026434 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 684/1359] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:39:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:39:15.318595 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-227c3a15-42e1-4e5a-ad80-767570e6dd18 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/58316507-e2b9-47a8-8c80-bbda6482c459" status: 202 len: 0 microversion: 2.1 time: 0.353742 Feb 17 03:39:15.319234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 676/1360] 10.222.0.57 () {58 vars in 1262 bytes} [Wed Feb 17 03:39:14 2021] DELETE /compute/v2.1/os-security-groups/58316507-e2b9-47a8-8c80-bbda6482c459 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 17 03:39:15.329764 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7a6d12ae-717b-4d89-97b4-b582d4589172 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '.version_select at 0x7f98b02cee18>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:16.488244 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7a6d12ae-717b-4d89-97b4-b582d4589172 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:16.497984 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7a6d12ae-717b-4d89-97b4-b582d4589172 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:16.498592 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7a6d12ae-717b-4d89-97b4-b582d4589172 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:16.499426 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7a6d12ae-717b-4d89-97b4-b582d4589172 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:16.500200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7a6d12ae-717b-4d89-97b4-b582d4589172 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:16.564226 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7a6d12ae-717b-4d89-97b4-b582d4589172 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Acquired lock "refresh_cache-307fa9d3-f0a5-4c33-aa27-7271e36ec239" {{(pid=98104) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:39:18.867354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-7a6d12ae-717b-4d89-97b4-b582d4589172 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Building network info cache for instance {{(pid=98104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 03:39:18.886005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-f061c179-7daa-4ee5-9406-d19b29266bb8 req-52387071-790a-4f29-adc5-100dc3598dfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "307fa9d3-f0a5-4c33-aa27-7271e36ec239", "tag": "88c76ccb-10fd-4edc-b372-9a3bad57e105"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:39:18.887930 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:39:18.887930 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:39:18.900280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-f061c179-7daa-4ee5-9406-d19b29266bb8 req-52387071-790a-4f29-adc5-100dc3598dfb service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:18.901235 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-f061c179-7daa-4ee5-9406-d19b29266bb8 req-52387071-790a-4f29-adc5-100dc3598dfb service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:18.922480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-f061c179-7daa-4ee5-9406-d19b29266bb8 req-52387071-790a-4f29-adc5-100dc3598dfb service nova] Creating event network-changed:88c76ccb-10fd-4edc-b372-9a3bad57e105 for instance 307fa9d3-f0a5-4c33-aa27-7271e36ec239 on hv-cinder-75994 Feb 17 03:39:18.928877 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-f061c179-7daa-4ee5-9406-d19b29266bb8 req-52387071-790a-4f29-adc5-100dc3598dfb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047428 Feb 17 03:39:18.930782 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 677/1361] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:39:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:39:20.733105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-7a6d12ae-717b-4d89-97b4-b582d4589172 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Updating instance_info_cache with network_info: [{"id": "88c76ccb-10fd-4edc-b372-9a3bad57e105", "address": "fa:16:3e:6d:43:11", "network": {"id": "b3188410-3b2d-4523-8ccc-1882d94255cc", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1775846261-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "688dfe990479484ba91f5f3241f71c34", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap88c76ccb-10", "ovs_interfaceid": "88c76ccb-10fd-4edc-b372-9a3bad57e105", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 03:39:20.754995 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7a6d12ae-717b-4d89-97b4-b582d4589172 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Releasing lock "refresh_cache-307fa9d3-f0a5-4c33-aa27-7271e36ec239" {{(pid=98104) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:39:20.756253 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7a6d12ae-717b-4d89-97b4-b582d4589172 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/c233df69-f187-433c-8fd9-0e589151b190" status: 202 len: 0 microversion: 2.1 time: 5.431823 Feb 17 03:39:20.757690 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 685/1362] 10.222.0.57 () {58 vars in 1253 bytes} [Wed Feb 17 03:39:15 2021] DELETE /compute/v2.1/os-floating-ips/c233df69-f187-433c-8fd9-0e589151b190 => generated 0 bytes in 5434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:39:20.768015 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f3e26b8b-40e3-4409-a250-64f3a264540a tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:20.769342 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f3e26b8b-40e3-4409-a250-64f3a264540a tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:20.781754 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f3e26b8b-40e3-4409-a250-64f3a264540a tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:20.782917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f3e26b8b-40e3-4409-a250-64f3a264540a tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:20.784391 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f3e26b8b-40e3-4409-a250-64f3a264540a tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:20.785125 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f3e26b8b-40e3-4409-a250-64f3a264540a tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:21.014230 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-f3e26b8b-40e3-4409-a250-64f3a264540a tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lazy-loading 'services' on Instance uuid 307fa9d3-f0a5-4c33-aa27-7271e36ec239 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:39:21.163332 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f3e26b8b-40e3-4409-a250-64f3a264540a tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "DELETE /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/os-volume_attachments/447e9f53-5ba0-46ee-8d35-1d6c69dfb0a8" status: 202 len: 0 microversion: 2.1 time: 0.400331 Feb 17 03:39:21.163919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 678/1363] 10.222.0.57 () {58 vars in 1406 bytes} [Wed Feb 17 03:39:20 2021] DELETE /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/os-volume_attachments/447e9f53-5ba0-46ee-8d35-1d6c69dfb0a8 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:39:21.173168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-aa16ce82-0a06-4197-9f26-16af1e471b40 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:21.174577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-aa16ce82-0a06-4197-9f26-16af1e471b40 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:21.183819 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aa16ce82-0a06-4197-9f26-16af1e471b40 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:21.184312 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aa16ce82-0a06-4197-9f26-16af1e471b40 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:21.185436 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aa16ce82-0a06-4197-9f26-16af1e471b40 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:21.186314 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aa16ce82-0a06-4197-9f26-16af1e471b40 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:21.272379 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-aa16ce82-0a06-4197-9f26-16af1e471b40 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103535 Feb 17 03:39:21.273062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 686/1364] 10.222.0.57 () {58 vars in 1292 bytes} [Wed Feb 17 03:39:21 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:39:22.287918 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f018ac05-baa0-45f3-bb91-709b3e351971 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:22.289100 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f018ac05-baa0-45f3-bb91-709b3e351971 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:22.297752 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f018ac05-baa0-45f3-bb91-709b3e351971 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:22.298274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f018ac05-baa0-45f3-bb91-709b3e351971 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:22.299211 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f018ac05-baa0-45f3-bb91-709b3e351971 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:22.299702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f018ac05-baa0-45f3-bb91-709b3e351971 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:22.372422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f018ac05-baa0-45f3-bb91-709b3e351971 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089889 Feb 17 03:39:22.373311 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 679/1365] 10.222.0.57 () {58 vars in 1292 bytes} [Wed Feb 17 03:39:22 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:39:23.384723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d745ae69-b3e8-41cc-8bcd-24ea1f2166aa tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:23.385806 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d745ae69-b3e8-41cc-8bcd-24ea1f2166aa tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:23.396129 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d745ae69-b3e8-41cc-8bcd-24ea1f2166aa tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:23.396767 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d745ae69-b3e8-41cc-8bcd-24ea1f2166aa tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:23.397497 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d745ae69-b3e8-41cc-8bcd-24ea1f2166aa tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:23.397993 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d745ae69-b3e8-41cc-8bcd-24ea1f2166aa tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:23.472045 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d745ae69-b3e8-41cc-8bcd-24ea1f2166aa tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091407 Feb 17 03:39:23.472684 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 687/1366] 10.222.0.57 () {58 vars in 1292 bytes} [Wed Feb 17 03:39:23 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 17 03:39:23.484215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-aace41d0-a111-4b13-936f-0f3a34193aa8 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:23.484798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-aace41d0-a111-4b13-936f-0f3a34193aa8 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:23.492684 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aace41d0-a111-4b13-936f-0f3a34193aa8 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:23.493253 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aace41d0-a111-4b13-936f-0f3a34193aa8 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:23.494105 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aace41d0-a111-4b13-936f-0f3a34193aa8 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:23.494596 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-aace41d0-a111-4b13-936f-0f3a34193aa8 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:23.666715 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-aace41d0-a111-4b13-936f-0f3a34193aa8 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] HTTP exception thrown: Instance 307fa9d3-f0a5-4c33-aa27-7271e36ec239 is not attached to volume 447e9f53-5ba0-46ee-8d35-1d6c69dfb0a8 Feb 17 03:39:23.667438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-aace41d0-a111-4b13-936f-0f3a34193aa8 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Returning 404 to user: Instance 307fa9d3-f0a5-4c33-aa27-7271e36ec239 is not attached to volume 447e9f53-5ba0-46ee-8d35-1d6c69dfb0a8 {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:39:23.668365 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-aace41d0-a111-4b13-936f-0f3a34193aa8 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "DELETE /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/os-volume_attachments/447e9f53-5ba0-46ee-8d35-1d6c69dfb0a8" status: 404 len: 154 microversion: 2.1 time: 0.188440 Feb 17 03:39:23.669097 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 680/1367] 10.222.0.57 () {58 vars in 1406 bytes} [Wed Feb 17 03:39:23 2021] DELETE /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239/os-volume_attachments/447e9f53-5ba0-46ee-8d35-1d6c69dfb0a8 => generated 154 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:39:24.923625 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f8839f46-c432-49d3-9483-540d78d6960b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:24.924214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f8839f46-c432-49d3-9483-540d78d6960b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:24.932066 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8839f46-c432-49d3-9483-540d78d6960b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:24.932565 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8839f46-c432-49d3-9483-540d78d6960b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:24.933447 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8839f46-c432-49d3-9483-540d78d6960b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:24.934126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f8839f46-c432-49d3-9483-540d78d6960b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:25.002004 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f8839f46-c432-49d3-9483-540d78d6960b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Going to try to terminate instance {{(pid=98104) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:39:25.120204 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f8839f46-c432-49d3-9483-540d78d6960b tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "DELETE /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 204 len: 0 microversion: 2.1 time: 0.199596 Feb 17 03:39:25.120860 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 688/1368] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:39:24 2021] DELETE /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:39:25.130145 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6a062a90-cc24-4b45-ba9b-d47eb17062bc tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:25.130802 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6a062a90-cc24-4b45-ba9b-d47eb17062bc tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:25.138747 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6a062a90-cc24-4b45-ba9b-d47eb17062bc tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:25.139300 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6a062a90-cc24-4b45-ba9b-d47eb17062bc tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:25.140128 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6a062a90-cc24-4b45-ba9b-d47eb17062bc tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:25.140609 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6a062a90-cc24-4b45-ba9b-d47eb17062bc tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:25.381088 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6a062a90-cc24-4b45-ba9b-d47eb17062bc tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:25.390146 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6a062a90-cc24-4b45-ba9b-d47eb17062bc tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1554 microversion: 2.1 time: 0.264465 Feb 17 03:39:25.390765 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 681/1369] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:25 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1554 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:26.417638 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e83ca3f8-55a2-416a-864c-4bd9da845a65 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:26.419007 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e83ca3f8-55a2-416a-864c-4bd9da845a65 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:26.434537 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e83ca3f8-55a2-416a-864c-4bd9da845a65 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:26.435393 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e83ca3f8-55a2-416a-864c-4bd9da845a65 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:26.437004 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e83ca3f8-55a2-416a-864c-4bd9da845a65 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:26.437927 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e83ca3f8-55a2-416a-864c-4bd9da845a65 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:26.677240 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e83ca3f8-55a2-416a-864c-4bd9da845a65 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:26.686201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e83ca3f8-55a2-416a-864c-4bd9da845a65 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1554 microversion: 2.1 time: 0.277249 Feb 17 03:39:26.686820 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 689/1370] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:26 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1554 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:27.705141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7d09055a-5ac3-4805-b63c-19350043a2a5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:27.705812 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7d09055a-5ac3-4805-b63c-19350043a2a5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:27.714898 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7d09055a-5ac3-4805-b63c-19350043a2a5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:27.715440 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7d09055a-5ac3-4805-b63c-19350043a2a5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:27.716233 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7d09055a-5ac3-4805-b63c-19350043a2a5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:27.716709 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7d09055a-5ac3-4805-b63c-19350043a2a5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:27.939103 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7d09055a-5ac3-4805-b63c-19350043a2a5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:27.949169 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7d09055a-5ac3-4805-b63c-19350043a2a5 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1554 microversion: 2.1 time: 0.247956 Feb 17 03:39:27.950078 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 682/1371] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:27 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1554 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:28.892573 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-1fe5351b-6782-462c-980d-5e31ef9e1729 req-d899eda0-af1f-44f8-9055-8bf96e969d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307fa9d3-f0a5-4c33-aa27-7271e36ec239", "name": "network-vif-deleted", "tag": "88c76ccb-10fd-4edc-b372-9a3bad57e105"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:39:28.896628 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:39:28.896628 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:39:28.911903 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-1fe5351b-6782-462c-980d-5e31ef9e1729 req-d899eda0-af1f-44f8-9055-8bf96e969d93 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:28.912945 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-1fe5351b-6782-462c-980d-5e31ef9e1729 req-d899eda0-af1f-44f8-9055-8bf96e969d93 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:28.936325 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-1fe5351b-6782-462c-980d-5e31ef9e1729 req-d899eda0-af1f-44f8-9055-8bf96e969d93 service nova] Creating event network-vif-deleted:88c76ccb-10fd-4edc-b372-9a3bad57e105 for instance 307fa9d3-f0a5-4c33-aa27-7271e36ec239 on hv-cinder-75994 Feb 17 03:39:28.942194 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-1fe5351b-6782-462c-980d-5e31ef9e1729 req-d899eda0-af1f-44f8-9055-8bf96e969d93 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057914 Feb 17 03:39:28.945425 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 690/1372] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:39:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:39:28.968389 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e5bb03a7-8157-430f-a916-5681376f0911 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:28.969072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e5bb03a7-8157-430f-a916-5681376f0911 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:28.977878 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5bb03a7-8157-430f-a916-5681376f0911 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:28.978685 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5bb03a7-8157-430f-a916-5681376f0911 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:28.979906 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5bb03a7-8157-430f-a916-5681376f0911 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:28.990000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5bb03a7-8157-430f-a916-5681376f0911 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:29.117723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e5bb03a7-8157-430f-a916-5681376f0911 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbaea093d10841038a9e1cf700d5e2ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688dfe990479484ba91f5f3241f71c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:29.126746 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e5bb03a7-8157-430f-a916-5681376f0911 tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 200 len: 1342 microversion: 2.1 time: 0.162669 Feb 17 03:39:29.127353 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 683/1373] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:28 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:29.622621 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:39:29.622783 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:39:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:39:30.146793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c72946b2-35d6-4818-8343-c69681bf98ce tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:30.147699 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c72946b2-35d6-4818-8343-c69681bf98ce tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] [instance: 307fa9d3-f0a5-4c33-aa27-7271e36ec239] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:30.155981 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c72946b2-35d6-4818-8343-c69681bf98ce tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:30.156493 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c72946b2-35d6-4818-8343-c69681bf98ce tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:30.157376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c72946b2-35d6-4818-8343-c69681bf98ce tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:30.157908 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c72946b2-35d6-4818-8343-c69681bf98ce tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:30.216270 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-c72946b2-35d6-4818-8343-c69681bf98ce tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] HTTP exception thrown: Instance 307fa9d3-f0a5-4c33-aa27-7271e36ec239 could not be found. Feb 17 03:39:30.216950 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c72946b2-35d6-4818-8343-c69681bf98ce tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Returning 404 to user: Instance 307fa9d3-f0a5-4c33-aa27-7271e36ec239 could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:39:30.217919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c72946b2-35d6-4818-8343-c69681bf98ce tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239" status: 404 len: 111 microversion: 2.1 time: 0.076297 Feb 17 03:39:30.218548 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 691/1374] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:30 2021] GET /compute/v2.1/servers/307fa9d3-f0a5-4c33-aa27-7271e36ec239 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:39:30.227438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ed84e41c-4e94-44f8-ad0d-39e79a72856e tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] Calling method '.version_select at 0x7f98b02c81e0>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:30.247266 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ed84e41c-4e94-44f8-ad0d-39e79a72856e tempest-TestMinimumBasicScenario-1245944238 tempest-TestMinimumBasicScenario-1245944238-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1289814794" status: 202 len: 0 microversion: 2.1 time: 0.023779 Feb 17 03:39:30.247915 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 684/1375] 10.222.0.57 () {58 vars in 1262 bytes} [Wed Feb 17 03:39:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1289814794 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:39:36.842680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8e63a3b3-b40b-47f7-ad16-64e44cf3ccb3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1912369765", "imageRef": "27891a64-31b3-4754-87b4-bf609a12c59a", "flavorRef": "452", "networks": [{"uuid": "373d2b80-c4ae-43a2-b4fd-925d2b965f1a"}]}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:39:36.914242 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-8e63a3b3-b40b-47f7-ad16-64e44cf3ccb3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] validate_networks() for [('373d2b80-c4ae-43a2-b4fd-925d2b965f1a', None, None, None)] {{(pid=98104) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:39:37.583265 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-8e63a3b3-b40b-47f7-ad16-64e44cf3ccb3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Flavor limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:39:37.583826 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-8e63a3b3-b40b-47f7-ad16-64e44cf3ccb3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Image limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:39:37.584494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-8e63a3b3-b40b-47f7-ad16-64e44cf3ccb3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Flavor pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:39:37.585461 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-8e63a3b3-b40b-47f7-ad16-64e44cf3ccb3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Image pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:39:37.586024 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-8e63a3b3-b40b-47f7-ad16-64e44cf3ccb3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:39:37.595204 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8e63a3b3-b40b-47f7-ad16-64e44cf3ccb3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:37.595717 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8e63a3b3-b40b-47f7-ad16-64e44cf3ccb3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:37.596596 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8e63a3b3-b40b-47f7-ad16-64e44cf3ccb3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:37.597114 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8e63a3b3-b40b-47f7-ad16-64e44cf3ccb3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:37.616459 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-8e63a3b3-b40b-47f7-ad16-64e44cf3ccb3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Getting quotas for project aea9cb666780439b80fcb18514f32228. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:39:37.620847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-8e63a3b3-b40b-47f7-ad16-64e44cf3ccb3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Getting quotas for user a6e23a58031d401b84f2b344cfc83dc0 and project aea9cb666780439b80fcb18514f32228. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:39:37.632344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8e63a3b3-b40b-47f7-ad16-64e44cf3ccb3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Going to run 1 instances... {{(pid=98104) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:39:37.635029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8e63a3b3-b40b-47f7-ad16-64e44cf3ccb3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27891a64-31b3-4754-87b4-bf609a12c59a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:39:37.687098 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8e63a3b3-b40b-47f7-ad16-64e44cf3ccb3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.848866 Feb 17 03:39:37.687978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 692/1376] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:39:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:39:37.699929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b4165b72-fb8e-4368-b076-3e787f819ddf tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:37.700610 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b4165b72-fb8e-4368-b076-3e787f819ddf tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:37.873248 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b4165b72-fb8e-4368-b076-3e787f819ddf tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:37.881776 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b4165b72-fb8e-4368-b076-3e787f819ddf tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d" status: 200 len: 1214 microversion: 2.1 time: 0.186708 Feb 17 03:39:37.883028 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 685/1377] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:37 2021] GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:38.902126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0567a33b-4784-4338-a210-cfacb34e8494 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:38.904005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0567a33b-4784-4338-a210-cfacb34e8494 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:38.913494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0567a33b-4784-4338-a210-cfacb34e8494 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:38.914472 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0567a33b-4784-4338-a210-cfacb34e8494 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:38.915966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0567a33b-4784-4338-a210-cfacb34e8494 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:38.916674 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0567a33b-4784-4338-a210-cfacb34e8494 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:39.060558 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0567a33b-4784-4338-a210-cfacb34e8494 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:39.070598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0567a33b-4784-4338-a210-cfacb34e8494 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d" status: 200 len: 1274 microversion: 2.1 time: 0.174214 Feb 17 03:39:39.071384 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 693/1378] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:38 2021] GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d => generated 1274 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:40.090141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8f79822d-4d4b-4e2e-a186-c1d2f03a2e99 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:40.090864 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8f79822d-4d4b-4e2e-a186-c1d2f03a2e99 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:40.098763 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f79822d-4d4b-4e2e-a186-c1d2f03a2e99 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:40.099269 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f79822d-4d4b-4e2e-a186-c1d2f03a2e99 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:40.100140 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f79822d-4d4b-4e2e-a186-c1d2f03a2e99 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:40.100605 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f79822d-4d4b-4e2e-a186-c1d2f03a2e99 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:40.565794 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8f79822d-4d4b-4e2e-a186-c1d2f03a2e99 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:40.575842 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8f79822d-4d4b-4e2e-a186-c1d2f03a2e99 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d" status: 200 len: 1314 microversion: 2.1 time: 0.490416 Feb 17 03:39:40.576447 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 686/1379] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:40 2021] GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:41.594634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e3835f8d-a0d7-4911-9218-f39b933e9c6e tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:41.595331 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e3835f8d-a0d7-4911-9218-f39b933e9c6e tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:41.603891 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e3835f8d-a0d7-4911-9218-f39b933e9c6e tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:41.604436 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e3835f8d-a0d7-4911-9218-f39b933e9c6e tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:41.605348 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e3835f8d-a0d7-4911-9218-f39b933e9c6e tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:41.605840 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e3835f8d-a0d7-4911-9218-f39b933e9c6e tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:41.757595 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-6bccaf91-1627-48f6-8095-540fc95f629e req-1d419c4c-312d-4a2f-bcdd-ae2864f2f5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "976ea954-86c8-4e2e-9a34-3e6c7b24ba1d", "tag": "6a2bb93d-16e5-49b2-88ec-7c7d2f130a09"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:39:41.760070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:39:41.760070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:39:41.770361 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-6bccaf91-1627-48f6-8095-540fc95f629e req-1d419c4c-312d-4a2f-bcdd-ae2864f2f5d4 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:41.770850 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-6bccaf91-1627-48f6-8095-540fc95f629e req-1d419c4c-312d-4a2f-bcdd-ae2864f2f5d4 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:41.792018 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-6bccaf91-1627-48f6-8095-540fc95f629e req-1d419c4c-312d-4a2f-bcdd-ae2864f2f5d4 service nova] Creating event network-changed:6a2bb93d-16e5-49b2-88ec-7c7d2f130a09 for instance 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d on hv-cinder-75994 Feb 17 03:39:41.797413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-6bccaf91-1627-48f6-8095-540fc95f629e req-1d419c4c-312d-4a2f-bcdd-ae2864f2f5d4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045559 Feb 17 03:39:41.798076 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 687/1380] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:39:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:39:42.025982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e3835f8d-a0d7-4911-9218-f39b933e9c6e tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:42.036265 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e3835f8d-a0d7-4911-9218-f39b933e9c6e tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d" status: 200 len: 1314 microversion: 2.1 time: 0.445846 Feb 17 03:39:42.036874 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 694/1381] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:41 2021] GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:43.055284 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f7c91c18-04b6-42b6-b98c-53d2bc19fb78 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:43.055983 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f7c91c18-04b6-42b6-b98c-53d2bc19fb78 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:43.065440 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7c91c18-04b6-42b6-b98c-53d2bc19fb78 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:43.065956 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7c91c18-04b6-42b6-b98c-53d2bc19fb78 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:43.066820 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7c91c18-04b6-42b6-b98c-53d2bc19fb78 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:43.067341 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7c91c18-04b6-42b6-b98c-53d2bc19fb78 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:43.290747 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f7c91c18-04b6-42b6-b98c-53d2bc19fb78 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:43.299968 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f7c91c18-04b6-42b6-b98c-53d2bc19fb78 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d" status: 200 len: 1314 microversion: 2.1 time: 0.249294 Feb 17 03:39:43.300591 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 688/1382] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:43 2021] GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:44.319849 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cbb362ff-a1de-4522-bbee-04fc6604658a tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:44.320402 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cbb362ff-a1de-4522-bbee-04fc6604658a tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:44.328705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cbb362ff-a1de-4522-bbee-04fc6604658a tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:44.329220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cbb362ff-a1de-4522-bbee-04fc6604658a tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:44.330065 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cbb362ff-a1de-4522-bbee-04fc6604658a tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:44.330556 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cbb362ff-a1de-4522-bbee-04fc6604658a tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:44.548572 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-cbb362ff-a1de-4522-bbee-04fc6604658a tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:44.558442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cbb362ff-a1de-4522-bbee-04fc6604658a tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d" status: 200 len: 1314 microversion: 2.1 time: 0.243475 Feb 17 03:39:44.559048 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 695/1383] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:44 2021] GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:45.576640 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5a731a0f-1643-4b8b-ad76-4e874326e6fd tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:45.578742 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5a731a0f-1643-4b8b-ad76-4e874326e6fd tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:45.586076 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a731a0f-1643-4b8b-ad76-4e874326e6fd tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:45.586588 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a731a0f-1643-4b8b-ad76-4e874326e6fd tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:45.587448 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a731a0f-1643-4b8b-ad76-4e874326e6fd tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:45.587937 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a731a0f-1643-4b8b-ad76-4e874326e6fd tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:45.952497 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5a731a0f-1643-4b8b-ad76-4e874326e6fd tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:45.961486 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5a731a0f-1643-4b8b-ad76-4e874326e6fd tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d" status: 200 len: 1314 microversion: 2.1 time: 0.389085 Feb 17 03:39:45.962090 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 689/1384] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:45 2021] GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:46.979650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-50b60f3b-88ed-43f2-a479-483365d651fa tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:46.980324 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-50b60f3b-88ed-43f2-a479-483365d651fa tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:46.988297 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-50b60f3b-88ed-43f2-a479-483365d651fa tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:46.988811 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-50b60f3b-88ed-43f2-a479-483365d651fa tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:46.989701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-50b60f3b-88ed-43f2-a479-483365d651fa tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:46.990197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-50b60f3b-88ed-43f2-a479-483365d651fa tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:47.207648 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-50b60f3b-88ed-43f2-a479-483365d651fa tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:47.216563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-50b60f3b-88ed-43f2-a479-483365d651fa tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d" status: 200 len: 1314 microversion: 2.1 time: 0.240929 Feb 17 03:39:47.217187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 696/1385] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:46 2021] GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:48.235190 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-94569789-b875-4536-9341-933e4c35184d tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:48.235841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-94569789-b875-4536-9341-933e4c35184d tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:48.244983 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-94569789-b875-4536-9341-933e4c35184d tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:48.245643 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-94569789-b875-4536-9341-933e4c35184d tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:48.246435 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-94569789-b875-4536-9341-933e4c35184d tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:48.246936 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-94569789-b875-4536-9341-933e4c35184d tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:48.379810 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-a6f3764a-4ff4-4ae4-857d-08eb19c749e7 req-9aac2fd9-4a3f-4824-8a2a-f780018db980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "976ea954-86c8-4e2e-9a34-3e6c7b24ba1d", "name": "network-vif-plugged", "status": "completed", "tag": "6a2bb93d-16e5-49b2-88ec-7c7d2f130a09"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:39:48.381679 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:39:48.381679 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:39:48.390892 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-a6f3764a-4ff4-4ae4-857d-08eb19c749e7 req-9aac2fd9-4a3f-4824-8a2a-f780018db980 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:48.391390 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-a6f3764a-4ff4-4ae4-857d-08eb19c749e7 req-9aac2fd9-4a3f-4824-8a2a-f780018db980 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:48.410224 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-a6f3764a-4ff4-4ae4-857d-08eb19c749e7 req-9aac2fd9-4a3f-4824-8a2a-f780018db980 service nova] Creating event network-vif-plugged:6a2bb93d-16e5-49b2-88ec-7c7d2f130a09 for instance 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d on hv-cinder-75994 Feb 17 03:39:48.415540 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-a6f3764a-4ff4-4ae4-857d-08eb19c749e7 req-9aac2fd9-4a3f-4824-8a2a-f780018db980 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040148 Feb 17 03:39:48.416194 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 697/1386] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:39:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:39:48.470691 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-94569789-b875-4536-9341-933e4c35184d tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:48.481198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-94569789-b875-4536-9341-933e4c35184d tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d" status: 200 len: 1314 microversion: 2.1 time: 0.249958 Feb 17 03:39:48.481941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 690/1387] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:48 2021] GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:49.500698 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-67c9bac6-8aa2-4870-b965-03b6cd5538ee tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:49.501505 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-67c9bac6-8aa2-4870-b965-03b6cd5538ee tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:49.510251 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-67c9bac6-8aa2-4870-b965-03b6cd5538ee tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:49.510748 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-67c9bac6-8aa2-4870-b965-03b6cd5538ee tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:49.511582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-67c9bac6-8aa2-4870-b965-03b6cd5538ee tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:49.512064 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-67c9bac6-8aa2-4870-b965-03b6cd5538ee tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:49.737452 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-67c9bac6-8aa2-4870-b965-03b6cd5538ee tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:49.746467 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-67c9bac6-8aa2-4870-b965-03b6cd5538ee tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d" status: 200 len: 1314 microversion: 2.1 time: 0.250574 Feb 17 03:39:49.747080 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 698/1388] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:49 2021] GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:50.765480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e45d9834-490c-4ae1-9779-94d62f976950 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:50.766120 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e45d9834-490c-4ae1-9779-94d62f976950 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:50.774824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e45d9834-490c-4ae1-9779-94d62f976950 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:50.775337 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e45d9834-490c-4ae1-9779-94d62f976950 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:50.776190 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e45d9834-490c-4ae1-9779-94d62f976950 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:50.776684 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e45d9834-490c-4ae1-9779-94d62f976950 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:50.996414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e45d9834-490c-4ae1-9779-94d62f976950 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:51.006027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e45d9834-490c-4ae1-9779-94d62f976950 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d" status: 200 len: 1497 microversion: 2.1 time: 0.244719 Feb 17 03:39:51.006632 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 691/1389] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:50 2021] GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d => generated 1497 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:39:51.771793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-dbdaab28-83b7-4373-9504-293221b274dd tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:51.772398 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-dbdaab28-83b7-4373-9504-293221b274dd tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:51.781072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dbdaab28-83b7-4373-9504-293221b274dd tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:51.781072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dbdaab28-83b7-4373-9504-293221b274dd tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:51.781723 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dbdaab28-83b7-4373-9504-293221b274dd tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:51.782221 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dbdaab28-83b7-4373-9504-293221b274dd tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:51.849594 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-dbdaab28-83b7-4373-9504-293221b274dd tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d] Going to try to terminate instance {{(pid=98104) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:39:51.971650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-dbdaab28-83b7-4373-9504-293221b274dd tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "DELETE /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d" status: 204 len: 0 microversion: 2.1 time: 0.203958 Feb 17 03:39:51.972257 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 699/1390] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:39:51 2021] DELETE /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:39:51.981181 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-06471a1d-b5f2-4918-b8e5-135626206929 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:51.981846 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-06471a1d-b5f2-4918-b8e5-135626206929 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:51.989858 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-06471a1d-b5f2-4918-b8e5-135626206929 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:51.990359 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-06471a1d-b5f2-4918-b8e5-135626206929 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:51.991198 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-06471a1d-b5f2-4918-b8e5-135626206929 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:51.991684 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-06471a1d-b5f2-4918-b8e5-135626206929 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:52.215012 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-06471a1d-b5f2-4918-b8e5-135626206929 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:52.224262 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-06471a1d-b5f2-4918-b8e5-135626206929 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d" status: 200 len: 1503 microversion: 2.1 time: 0.247081 Feb 17 03:39:52.224796 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 692/1391] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:51 2021] GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d => generated 1503 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:39:53.243524 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7e61bcca-bf2b-42a2-b10e-e47aae8cc6f2 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:53.244222 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7e61bcca-bf2b-42a2-b10e-e47aae8cc6f2 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:53.252355 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7e61bcca-bf2b-42a2-b10e-e47aae8cc6f2 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:53.252877 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7e61bcca-bf2b-42a2-b10e-e47aae8cc6f2 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:53.253760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7e61bcca-bf2b-42a2-b10e-e47aae8cc6f2 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:53.254257 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7e61bcca-bf2b-42a2-b10e-e47aae8cc6f2 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:53.491392 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7e61bcca-bf2b-42a2-b10e-e47aae8cc6f2 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:53.503542 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7e61bcca-bf2b-42a2-b10e-e47aae8cc6f2 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d" status: 200 len: 1503 microversion: 2.1 time: 0.264565 Feb 17 03:39:53.504164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 700/1392] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:53 2021] GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:54.523527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fac65299-e03e-498a-8276-77b0e20ad425 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:54.524239 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fac65299-e03e-498a-8276-77b0e20ad425 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:54.532443 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fac65299-e03e-498a-8276-77b0e20ad425 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:54.532952 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fac65299-e03e-498a-8276-77b0e20ad425 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:54.533823 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fac65299-e03e-498a-8276-77b0e20ad425 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:54.534317 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fac65299-e03e-498a-8276-77b0e20ad425 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:54.663220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-fac65299-e03e-498a-8276-77b0e20ad425 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:54.672011 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fac65299-e03e-498a-8276-77b0e20ad425 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d" status: 200 len: 1461 microversion: 2.1 time: 0.153664 Feb 17 03:39:54.672615 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 693/1393] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:54 2021] GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d => generated 1461 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:54.755184 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-1b968cbe-c66a-4448-971c-fa2e7a6e295f req-3648efce-9781-480c-a07f-5a60fb6a264a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "976ea954-86c8-4e2e-9a34-3e6c7b24ba1d", "name": "network-vif-deleted", "tag": "6a2bb93d-16e5-49b2-88ec-7c7d2f130a09"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:39:54.757227 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:39:54.757227 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:39:54.767377 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-1b968cbe-c66a-4448-971c-fa2e7a6e295f req-3648efce-9781-480c-a07f-5a60fb6a264a service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:54.767874 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-1b968cbe-c66a-4448-971c-fa2e7a6e295f req-3648efce-9781-480c-a07f-5a60fb6a264a service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:54.788180 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-1b968cbe-c66a-4448-971c-fa2e7a6e295f req-3648efce-9781-480c-a07f-5a60fb6a264a service nova] Creating event network-vif-deleted:6a2bb93d-16e5-49b2-88ec-7c7d2f130a09 for instance 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d on hv-cinder-75994 Feb 17 03:39:54.793229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-1b968cbe-c66a-4448-971c-fa2e7a6e295f req-3648efce-9781-480c-a07f-5a60fb6a264a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042048 Feb 17 03:39:54.793886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 701/1394] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:39:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:39:55.188051 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2ce773df-c8eb-49e1-b025-2923a2ce98e8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:55.188598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2ce773df-c8eb-49e1-b025-2923a2ce98e8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:55.197121 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ce773df-c8eb-49e1-b025-2923a2ce98e8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:55.197871 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ce773df-c8eb-49e1-b025-2923a2ce98e8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:55.198745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ce773df-c8eb-49e1-b025-2923a2ce98e8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:55.199218 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ce773df-c8eb-49e1-b025-2923a2ce98e8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:55.265705 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2ce773df-c8eb-49e1-b025-2923a2ce98e8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Going to try to terminate instance {{(pid=98103) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:39:55.389046 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2ce773df-c8eb-49e1-b025-2923a2ce98e8 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "DELETE /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 204 len: 0 microversion: 2.20 time: 0.204440 Feb 17 03:39:55.390155 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 694/1395] 10.222.0.57 () {60 vars in 1270 bytes} [Wed Feb 17 03:39:55 2021] DELETE /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 17 03:39:55.400736 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e17f4ed7-5389-4f0b-a96c-1a32dcdd0704 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:55.401536 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e17f4ed7-5389-4f0b-a96c-1a32dcdd0704 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:55.410395 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e17f4ed7-5389-4f0b-a96c-1a32dcdd0704 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:55.410922 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e17f4ed7-5389-4f0b-a96c-1a32dcdd0704 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:55.411770 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e17f4ed7-5389-4f0b-a96c-1a32dcdd0704 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:55.412256 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e17f4ed7-5389-4f0b-a96c-1a32dcdd0704 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:55.630629 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e17f4ed7-5389-4f0b-a96c-1a32dcdd0704 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:55.640144 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e17f4ed7-5389-4f0b-a96c-1a32dcdd0704 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:55.641758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e17f4ed7-5389-4f0b-a96c-1a32dcdd0704 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:55.642946 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e17f4ed7-5389-4f0b-a96c-1a32dcdd0704 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1723 microversion: 2.20 time: 0.246847 Feb 17 03:39:55.643535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 702/1396] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:39:55 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:39:55.692005 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-26a92cc1-d981-4ac4-93a4-dd63a5fffb57 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:55.693254 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-26a92cc1-d981-4ac4-93a4-dd63a5fffb57 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:55.701501 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-26a92cc1-d981-4ac4-93a4-dd63a5fffb57 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:55.702011 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-26a92cc1-d981-4ac4-93a4-dd63a5fffb57 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:55.702862 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-26a92cc1-d981-4ac4-93a4-dd63a5fffb57 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:55.703354 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-26a92cc1-d981-4ac4-93a4-dd63a5fffb57 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:55.761529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-26a92cc1-d981-4ac4-93a4-dd63a5fffb57 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] HTTP exception thrown: Instance 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d could not be found. Feb 17 03:39:55.762204 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-26a92cc1-d981-4ac4-93a4-dd63a5fffb57 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Returning 404 to user: Instance 976ea954-86c8-4e2e-9a34-3e6c7b24ba1d could not be found. {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:39:55.763113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-26a92cc1-d981-4ac4-93a4-dd63a5fffb57 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d" status: 404 len: 111 microversion: 2.1 time: 0.076138 Feb 17 03:39:55.763726 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 695/1397] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:55 2021] GET /compute/v2.1/servers/976ea954-86c8-4e2e-9a34-3e6c7b24ba1d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:39:55.886226 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-492fa6dc-4de7-4c9f-b6a6-ce71ed3c8613 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-143500096", "imageRef": "27891a64-31b3-4754-87b4-bf609a12c59a", "flavorRef": "452", "networks": [{"uuid": "373d2b80-c4ae-43a2-b4fd-925d2b965f1a"}]}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:39:55.954421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-492fa6dc-4de7-4c9f-b6a6-ce71ed3c8613 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] validate_networks() for [('373d2b80-c4ae-43a2-b4fd-925d2b965f1a', None, None, None)] {{(pid=98104) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:39:56.522097 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-492fa6dc-4de7-4c9f-b6a6-ce71ed3c8613 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Flavor limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:39:56.522581 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-492fa6dc-4de7-4c9f-b6a6-ce71ed3c8613 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Image limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:39:56.523132 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-492fa6dc-4de7-4c9f-b6a6-ce71ed3c8613 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Flavor pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:39:56.523640 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-492fa6dc-4de7-4c9f-b6a6-ce71ed3c8613 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Image pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:39:56.524109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-492fa6dc-4de7-4c9f-b6a6-ce71ed3c8613 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:39:56.533503 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-492fa6dc-4de7-4c9f-b6a6-ce71ed3c8613 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:56.534015 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-492fa6dc-4de7-4c9f-b6a6-ce71ed3c8613 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:56.534895 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-492fa6dc-4de7-4c9f-b6a6-ce71ed3c8613 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:56.535394 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-492fa6dc-4de7-4c9f-b6a6-ce71ed3c8613 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:56.554201 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-492fa6dc-4de7-4c9f-b6a6-ce71ed3c8613 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Getting quotas for project aea9cb666780439b80fcb18514f32228. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:39:56.558601 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-492fa6dc-4de7-4c9f-b6a6-ce71ed3c8613 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Getting quotas for user a6e23a58031d401b84f2b344cfc83dc0 and project aea9cb666780439b80fcb18514f32228. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:39:56.570882 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-492fa6dc-4de7-4c9f-b6a6-ce71ed3c8613 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Going to run 1 instances... {{(pid=98104) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:39:56.573788 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-492fa6dc-4de7-4c9f-b6a6-ce71ed3c8613 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27891a64-31b3-4754-87b4-bf609a12c59a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:39:56.624212 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-492fa6dc-4de7-4c9f-b6a6-ce71ed3c8613 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.742050 Feb 17 03:39:56.625847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 703/1398] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:39:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:39:56.636446 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f3dbb971-598e-482e-bb14-35527f674dbf tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:56.637167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f3dbb971-598e-482e-bb14-35527f674dbf tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:56.663101 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-629e096e-0d43-4f47-80e9-10391ddcf95c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:56.663861 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-629e096e-0d43-4f47-80e9-10391ddcf95c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:56.672868 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-629e096e-0d43-4f47-80e9-10391ddcf95c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:56.673422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-629e096e-0d43-4f47-80e9-10391ddcf95c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:56.674276 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-629e096e-0d43-4f47-80e9-10391ddcf95c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:56.674770 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-629e096e-0d43-4f47-80e9-10391ddcf95c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:56.718042 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f3dbb971-598e-482e-bb14-35527f674dbf tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:56.727505 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f3dbb971-598e-482e-bb14-35527f674dbf tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb" status: 200 len: 1213 microversion: 2.1 time: 0.095203 Feb 17 03:39:56.728343 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 696/1399] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:56 2021] GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:56.939428 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-629e096e-0d43-4f47-80e9-10391ddcf95c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:56.954110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-629e096e-0d43-4f47-80e9-10391ddcf95c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:56.956550 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-629e096e-0d43-4f47-80e9-10391ddcf95c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:56.958118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-629e096e-0d43-4f47-80e9-10391ddcf95c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1723 microversion: 2.20 time: 0.299234 Feb 17 03:39:56.959139 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 704/1400] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:39:56 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:39:57.755895 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6c2a3b01-1a30-4c02-b9a3-6c74ff00e9fe tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:57.756645 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6c2a3b01-1a30-4c02-b9a3-6c74ff00e9fe tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:57.765142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6c2a3b01-1a30-4c02-b9a3-6c74ff00e9fe tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:57.765670 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6c2a3b01-1a30-4c02-b9a3-6c74ff00e9fe tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:57.766568 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6c2a3b01-1a30-4c02-b9a3-6c74ff00e9fe tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:57.767109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6c2a3b01-1a30-4c02-b9a3-6c74ff00e9fe tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:57.911523 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6c2a3b01-1a30-4c02-b9a3-6c74ff00e9fe tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:57.920680 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6c2a3b01-1a30-4c02-b9a3-6c74ff00e9fe tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb" status: 200 len: 1273 microversion: 2.1 time: 0.169411 Feb 17 03:39:57.921318 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 697/1401] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:57 2021] GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb => generated 1273 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:39:57.979396 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b6e26b7d-4658-40e1-8331-7ace725f8fb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:57.980261 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b6e26b7d-4658-40e1-8331-7ace725f8fb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:57.988357 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b6e26b7d-4658-40e1-8331-7ace725f8fb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:57.988922 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b6e26b7d-4658-40e1-8331-7ace725f8fb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:57.990302 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b6e26b7d-4658-40e1-8331-7ace725f8fb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:57.990793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b6e26b7d-4658-40e1-8331-7ace725f8fb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:58.639153 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b6e26b7d-4658-40e1-8331-7ace725f8fb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:58.649342 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b6e26b7d-4658-40e1-8331-7ace725f8fb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:58.650926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b6e26b7d-4658-40e1-8331-7ace725f8fb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:58.652120 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b6e26b7d-4658-40e1-8331-7ace725f8fb2 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1723 microversion: 2.20 time: 0.676811 Feb 17 03:39:58.652700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 705/1402] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:39:57 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1723 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:39:58.940036 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5187a4e3-4a41-4ec1-9522-ee0513505140 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:58.940634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5187a4e3-4a41-4ec1-9522-ee0513505140 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:58.949403 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5187a4e3-4a41-4ec1-9522-ee0513505140 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:58.949906 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5187a4e3-4a41-4ec1-9522-ee0513505140 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:58.950752 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5187a4e3-4a41-4ec1-9522-ee0513505140 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:58.951245 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5187a4e3-4a41-4ec1-9522-ee0513505140 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:59.079499 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5187a4e3-4a41-4ec1-9522-ee0513505140 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:59.088643 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5187a4e3-4a41-4ec1-9522-ee0513505140 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb" status: 200 len: 1271 microversion: 2.1 time: 0.152540 Feb 17 03:39:59.089306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 698/1403] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:39:58 2021] GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:39:59.673431 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-dd52f717-2e6f-4d5d-9313-1422270d302f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:39:59.674134 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-dd52f717-2e6f-4d5d-9313-1422270d302f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:39:59.682577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dd52f717-2e6f-4d5d-9313-1422270d302f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:59.683077 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dd52f717-2e6f-4d5d-9313-1422270d302f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:59.684507 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dd52f717-2e6f-4d5d-9313-1422270d302f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:39:59.684996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dd52f717-2e6f-4d5d-9313-1422270d302f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:39:59.849117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dd52f717-2e6f-4d5d-9313-1422270d302f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:59.875367 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dd52f717-2e6f-4d5d-9313-1422270d302f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:59.878996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dd52f717-2e6f-4d5d-9313-1422270d302f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:39:59.880653 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-dd52f717-2e6f-4d5d-9313-1422270d302f tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1656 microversion: 2.20 time: 0.211402 Feb 17 03:39:59.881510 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 706/1404] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:39:59 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1656 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:40:00.112375 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2a3e1db5-09cd-4664-9552-2f78dbb6f67a tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:00.112965 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2a3e1db5-09cd-4664-9552-2f78dbb6f67a tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:00.121337 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2a3e1db5-09cd-4664-9552-2f78dbb6f67a tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:00.122285 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2a3e1db5-09cd-4664-9552-2f78dbb6f67a tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:00.122695 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2a3e1db5-09cd-4664-9552-2f78dbb6f67a tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:00.123192 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2a3e1db5-09cd-4664-9552-2f78dbb6f67a tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:00.264760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2a3e1db5-09cd-4664-9552-2f78dbb6f67a tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:40:00.275659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2a3e1db5-09cd-4664-9552-2f78dbb6f67a tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb" status: 200 len: 1271 microversion: 2.1 time: 0.168927 Feb 17 03:40:00.276274 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 699/1405] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:40:00 2021] GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:40:00.425370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-571e8633-744a-4278-8417-1e4668a6ccad req-929f5997-7dbf-444c-8a78-fa15aecc2af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb13b0aa-8bce-4878-943d-e3483a430b36", "name": "network-vif-deleted", "tag": "3536cbed-2c8d-4d95-bbc0-f2840e848748"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:40:00.427153 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:40:00.427153 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:40:00.437640 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-571e8633-744a-4278-8417-1e4668a6ccad req-929f5997-7dbf-444c-8a78-fa15aecc2af0 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:00.438144 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-571e8633-744a-4278-8417-1e4668a6ccad req-929f5997-7dbf-444c-8a78-fa15aecc2af0 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:00.463364 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-571e8633-744a-4278-8417-1e4668a6ccad req-929f5997-7dbf-444c-8a78-fa15aecc2af0 service nova] Creating event network-vif-deleted:3536cbed-2c8d-4d95-bbc0-f2840e848748 for instance eb13b0aa-8bce-4878-943d-e3483a430b36 on hv-cinder-75994 Feb 17 03:40:00.469422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-571e8633-744a-4278-8417-1e4668a6ccad req-929f5997-7dbf-444c-8a78-fa15aecc2af0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048002 Feb 17 03:40:00.470360 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 707/1406] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:40:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:40:00.902436 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7fe30079-2926-49e4-8944-e8315b911b1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:00.903467 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7fe30079-2926-49e4-8944-e8315b911b1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:00.913182 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7fe30079-2926-49e4-8944-e8315b911b1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:00.913800 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7fe30079-2926-49e4-8944-e8315b911b1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:00.914702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7fe30079-2926-49e4-8944-e8315b911b1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:00.915398 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7fe30079-2926-49e4-8944-e8315b911b1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:01.005118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7fe30079-2926-49e4-8944-e8315b911b1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:01.005758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7fe30079-2926-49e4-8944-e8315b911b1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:01.006678 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-7fe30079-2926-49e4-8944-e8315b911b1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lazy-loading 'fault' on Instance uuid eb13b0aa-8bce-4878-943d-e3483a430b36 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:40:01.080729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7fe30079-2926-49e4-8944-e8315b911b1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:40:01.091533 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7fe30079-2926-49e4-8944-e8315b911b1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:40:01.093979 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7fe30079-2926-49e4-8944-e8315b911b1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd89f687506dc43c6b64ec46ad1396b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64044155addf41e9ba2bde5782afed2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:40:01.095478 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7fe30079-2926-49e4-8944-e8315b911b1e tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 200 len: 1372 microversion: 2.20 time: 0.198595 Feb 17 03:40:01.096233 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 700/1407] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:40:00 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 17 03:40:01.294757 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2ede0029-c695-418d-8555-cacfdfd5c00b tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:01.296174 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2ede0029-c695-418d-8555-cacfdfd5c00b tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:01.305417 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ede0029-c695-418d-8555-cacfdfd5c00b tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:01.306220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ede0029-c695-418d-8555-cacfdfd5c00b tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:01.307297 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ede0029-c695-418d-8555-cacfdfd5c00b tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:01.307982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2ede0029-c695-418d-8555-cacfdfd5c00b tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:01.885559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2ede0029-c695-418d-8555-cacfdfd5c00b tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:40:01.901646 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2ede0029-c695-418d-8555-cacfdfd5c00b tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb" status: 200 len: 1313 microversion: 2.1 time: 0.611070 Feb 17 03:40:01.908827 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 708/1408] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:40:01 2021] GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb => generated 1313 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:40:02.116022 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0389f72e-85ad-48b9-9a24-16d53795644a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:02.117067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0389f72e-85ad-48b9-9a24-16d53795644a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:02.125486 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0389f72e-85ad-48b9-9a24-16d53795644a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:02.126154 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0389f72e-85ad-48b9-9a24-16d53795644a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:02.127189 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0389f72e-85ad-48b9-9a24-16d53795644a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:02.127819 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0389f72e-85ad-48b9-9a24-16d53795644a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:02.183849 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-0389f72e-85ad-48b9-9a24-16d53795644a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] HTTP exception thrown: Instance eb13b0aa-8bce-4878-943d-e3483a430b36 could not be found. Feb 17 03:40:02.184846 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0389f72e-85ad-48b9-9a24-16d53795644a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Returning 404 to user: Instance eb13b0aa-8bce-4878-943d-e3483a430b36 could not be found. {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:40:02.185798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0389f72e-85ad-48b9-9a24-16d53795644a tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 404 len: 111 microversion: 2.20 time: 0.073963 Feb 17 03:40:02.186398 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 701/1409] 10.222.0.57 () {60 vars in 1267 bytes} [Wed Feb 17 03:40:02 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 17 03:40:02.195733 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-738ec1b1-e6a0-4d97-b158-8305a2904e66 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '.version_select at 0x7f98b00b79d8>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:02.219611 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-738ec1b1-e6a0-4d97-b158-8305a2904e66 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054237630" status: 204 len: 0 microversion: 2.20 time: 0.027750 Feb 17 03:40:02.220384 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 709/1410] 10.222.0.57 () {60 vars in 1252 bytes} [Wed Feb 17 03:40:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054237630 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 17 03:40:02.579970 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-6284747f-9b17-4235-b9b4-653bd193532e req-2ba14bae-93b0-40a8-a3d6-ef8ac645646c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b43b2a-76c7-475b-a6b4-244e05f28fbb", "tag": "0eca2669-27fc-4ad4-9d65-39f38d830a3d"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:40:02.581768 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:40:02.581768 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:40:02.593313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-6284747f-9b17-4235-b9b4-653bd193532e req-2ba14bae-93b0-40a8-a3d6-ef8ac645646c service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:02.593918 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-6284747f-9b17-4235-b9b4-653bd193532e req-2ba14bae-93b0-40a8-a3d6-ef8ac645646c service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:02.615630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-6284747f-9b17-4235-b9b4-653bd193532e req-2ba14bae-93b0-40a8-a3d6-ef8ac645646c service nova] Creating event network-changed:0eca2669-27fc-4ad4-9d65-39f38d830a3d for instance 41b43b2a-76c7-475b-a6b4-244e05f28fbb on hv-cinder-75994 Feb 17 03:40:02.620770 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-6284747f-9b17-4235-b9b4-653bd193532e req-2ba14bae-93b0-40a8-a3d6-ef8ac645646c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044844 Feb 17 03:40:02.621707 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 702/1411] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:40:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:40:02.920079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8bda4a03-73db-4d15-94af-2ed47c87ae88 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:02.921085 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8bda4a03-73db-4d15-94af-2ed47c87ae88 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:02.930282 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8bda4a03-73db-4d15-94af-2ed47c87ae88 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:02.930790 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8bda4a03-73db-4d15-94af-2ed47c87ae88 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:02.931641 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8bda4a03-73db-4d15-94af-2ed47c87ae88 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:02.932124 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8bda4a03-73db-4d15-94af-2ed47c87ae88 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:03.216642 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8bda4a03-73db-4d15-94af-2ed47c87ae88 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:40:03.226947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8bda4a03-73db-4d15-94af-2ed47c87ae88 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb" status: 200 len: 1313 microversion: 2.1 time: 0.310802 Feb 17 03:40:03.227985 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 710/1412] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:40:02 2021] GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:40:04.246063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d92365fa-2122-4446-856b-779e18a1e246 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:04.246755 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d92365fa-2122-4446-856b-779e18a1e246 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:04.254997 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d92365fa-2122-4446-856b-779e18a1e246 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:04.255506 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d92365fa-2122-4446-856b-779e18a1e246 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:04.256363 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d92365fa-2122-4446-856b-779e18a1e246 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:04.256856 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d92365fa-2122-4446-856b-779e18a1e246 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:04.485943 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d92365fa-2122-4446-856b-779e18a1e246 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:40:04.494875 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d92365fa-2122-4446-856b-779e18a1e246 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb" status: 200 len: 1313 microversion: 2.1 time: 0.253370 Feb 17 03:40:04.495482 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 703/1413] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:40:04 2021] GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:40:04.734983 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7d4ced86-6671-48ed-a30c-c676ef04d844 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:04.735531 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7d4ced86-6671-48ed-a30c-c676ef04d844 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:04.744098 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7d4ced86-6671-48ed-a30c-c676ef04d844 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:04.744602 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7d4ced86-6671-48ed-a30c-c676ef04d844 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:04.745479 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7d4ced86-6671-48ed-a30c-c676ef04d844 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:04.745973 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7d4ced86-6671-48ed-a30c-c676ef04d844 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:04.799323 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-7d4ced86-6671-48ed-a30c-c676ef04d844 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] HTTP exception thrown: Instance eb13b0aa-8bce-4878-943d-e3483a430b36 could not be found. Feb 17 03:40:04.799988 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7d4ced86-6671-48ed-a30c-c676ef04d844 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Returning 404 to user: Instance eb13b0aa-8bce-4878-943d-e3483a430b36 could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:40:04.800896 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7d4ced86-6671-48ed-a30c-c676ef04d844 tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "DELETE /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 404 len: 111 microversion: 2.1 time: 0.069951 Feb 17 03:40:04.802067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 711/1414] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:40:04 2021] DELETE /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:40:04.810864 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-13249019-1636-4039-95f6-c0b1db8a18be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:04.811599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-13249019-1636-4039-95f6-c0b1db8a18be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: eb13b0aa-8bce-4878-943d-e3483a430b36] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:04.820280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-13249019-1636-4039-95f6-c0b1db8a18be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:04.820783 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-13249019-1636-4039-95f6-c0b1db8a18be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:04.821658 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-13249019-1636-4039-95f6-c0b1db8a18be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:04.822141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-13249019-1636-4039-95f6-c0b1db8a18be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:04.880548 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-13249019-1636-4039-95f6-c0b1db8a18be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] HTTP exception thrown: Instance eb13b0aa-8bce-4878-943d-e3483a430b36 could not be found. Feb 17 03:40:04.881248 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-13249019-1636-4039-95f6-c0b1db8a18be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Returning 404 to user: Instance eb13b0aa-8bce-4878-943d-e3483a430b36 could not be found. {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:40:04.882706 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-13249019-1636-4039-95f6-c0b1db8a18be tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36" status: 404 len: 111 microversion: 2.1 time: 0.075508 Feb 17 03:40:04.883467 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 704/1415] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:40:04 2021] GET /compute/v2.1/servers/eb13b0aa-8bce-4878-943d-e3483a430b36 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:40:05.513220 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9c99e2c7-7582-43d9-9ee0-745f98435a23 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:05.513899 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9c99e2c7-7582-43d9-9ee0-745f98435a23 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:05.522356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9c99e2c7-7582-43d9-9ee0-745f98435a23 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:05.522869 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9c99e2c7-7582-43d9-9ee0-745f98435a23 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:05.523721 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9c99e2c7-7582-43d9-9ee0-745f98435a23 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:05.524222 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9c99e2c7-7582-43d9-9ee0-745f98435a23 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:05.736679 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9c99e2c7-7582-43d9-9ee0-745f98435a23 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:40:05.745850 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9c99e2c7-7582-43d9-9ee0-745f98435a23 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb" status: 200 len: 1313 microversion: 2.1 time: 0.236548 Feb 17 03:40:05.746376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 712/1416] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:40:05 2021] GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:40:06.127517 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-776235f9-698e-4f17-8fe5-c4911b9d816c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:06.128067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-776235f9-698e-4f17-8fe5-c4911b9d816c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:06.136505 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-776235f9-698e-4f17-8fe5-c4911b9d816c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:06.137091 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-776235f9-698e-4f17-8fe5-c4911b9d816c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:06.137935 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-776235f9-698e-4f17-8fe5-c4911b9d816c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:06.138432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-776235f9-698e-4f17-8fe5-c4911b9d816c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:06.191504 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-776235f9-698e-4f17-8fe5-c4911b9d816c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] HTTP exception thrown: Instance 4840bec6-59fa-4a75-9cab-b8eba3fced9d could not be found. Feb 17 03:40:06.192659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-776235f9-698e-4f17-8fe5-c4911b9d816c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Returning 404 to user: Instance 4840bec6-59fa-4a75-9cab-b8eba3fced9d could not be found. {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:40:06.193606 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-776235f9-698e-4f17-8fe5-c4911b9d816c tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 404 len: 111 microversion: 2.1 time: 0.070196 Feb 17 03:40:06.194230 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 705/1417] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:40:06 2021] DELETE /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:40:06.203311 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f6676a62-fe30-40c8-9a6c-155755bcc76b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:06.203972 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f6676a62-fe30-40c8-9a6c-155755bcc76b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] [instance: 4840bec6-59fa-4a75-9cab-b8eba3fced9d] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:06.212661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6676a62-fe30-40c8-9a6c-155755bcc76b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:06.213183 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6676a62-fe30-40c8-9a6c-155755bcc76b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:06.214029 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6676a62-fe30-40c8-9a6c-155755bcc76b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:06.214518 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6676a62-fe30-40c8-9a6c-155755bcc76b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:06.272298 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-f6676a62-fe30-40c8-9a6c-155755bcc76b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] HTTP exception thrown: Instance 4840bec6-59fa-4a75-9cab-b8eba3fced9d could not be found. Feb 17 03:40:06.272964 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f6676a62-fe30-40c8-9a6c-155755bcc76b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] Returning 404 to user: Instance 4840bec6-59fa-4a75-9cab-b8eba3fced9d could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:40:06.273904 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f6676a62-fe30-40c8-9a6c-155755bcc76b tempest-AttachVolumeShelveTestJSON-2139089865 tempest-AttachVolumeShelveTestJSON-2139089865-project] 10.222.0.57 "GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d" status: 404 len: 111 microversion: 2.1 time: 0.074933 Feb 17 03:40:06.274513 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 713/1418] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:40:06 2021] GET /compute/v2.1/servers/4840bec6-59fa-4a75-9cab-b8eba3fced9d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:40:06.764364 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bfa482ba-f042-4e16-906b-67847474fd55 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:06.765059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-bfa482ba-f042-4e16-906b-67847474fd55 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:06.773421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bfa482ba-f042-4e16-906b-67847474fd55 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:06.773941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bfa482ba-f042-4e16-906b-67847474fd55 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:06.774796 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bfa482ba-f042-4e16-906b-67847474fd55 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:06.775288 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-bfa482ba-f042-4e16-906b-67847474fd55 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:07.095698 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-bfa482ba-f042-4e16-906b-67847474fd55 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:40:07.105749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bfa482ba-f042-4e16-906b-67847474fd55 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb" status: 200 len: 1313 microversion: 2.1 time: 0.345552 Feb 17 03:40:07.106367 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 706/1419] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:40:06 2021] GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:40:08.124113 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cc700f85-48d6-4cb2-b086-bdb506d9f34c tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:08.124942 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cc700f85-48d6-4cb2-b086-bdb506d9f34c tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:08.132957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cc700f85-48d6-4cb2-b086-bdb506d9f34c tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:08.133521 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cc700f85-48d6-4cb2-b086-bdb506d9f34c tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:08.134378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cc700f85-48d6-4cb2-b086-bdb506d9f34c tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:08.134852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cc700f85-48d6-4cb2-b086-bdb506d9f34c tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:08.271845 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-09747a90-3ed9-4554-8ae7-d937b98231c8 req-ba6ca22b-9938-4ef4-b7c2-2bbc4f6ad35c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b43b2a-76c7-475b-a6b4-244e05f28fbb", "name": "network-vif-plugged", "status": "completed", "tag": "0eca2669-27fc-4ad4-9d65-39f38d830a3d"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:40:08.274344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:40:08.274344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:40:08.283530 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-09747a90-3ed9-4554-8ae7-d937b98231c8 req-ba6ca22b-9938-4ef4-b7c2-2bbc4f6ad35c service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:08.284567 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-09747a90-3ed9-4554-8ae7-d937b98231c8 req-ba6ca22b-9938-4ef4-b7c2-2bbc4f6ad35c service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:08.304907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-09747a90-3ed9-4554-8ae7-d937b98231c8 req-ba6ca22b-9938-4ef4-b7c2-2bbc4f6ad35c service nova] Creating event network-vif-plugged:0eca2669-27fc-4ad4-9d65-39f38d830a3d for instance 41b43b2a-76c7-475b-a6b4-244e05f28fbb on hv-cinder-75994 Feb 17 03:40:08.310637 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-09747a90-3ed9-4554-8ae7-d937b98231c8 req-ba6ca22b-9938-4ef4-b7c2-2bbc4f6ad35c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044779 Feb 17 03:40:08.311625 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 707/1420] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:40:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:40:08.378365 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-cc700f85-48d6-4cb2-b086-bdb506d9f34c tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:40:08.389784 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cc700f85-48d6-4cb2-b086-bdb506d9f34c tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb" status: 200 len: 1313 microversion: 2.1 time: 0.269828 Feb 17 03:40:08.390322 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 714/1421] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:40:08 2021] GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:40:09.407982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-317b11a2-6dff-48ca-97c6-06ed64fa95c1 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:09.408765 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-317b11a2-6dff-48ca-97c6-06ed64fa95c1 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:09.417897 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-317b11a2-6dff-48ca-97c6-06ed64fa95c1 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:09.418409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-317b11a2-6dff-48ca-97c6-06ed64fa95c1 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:09.419279 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-317b11a2-6dff-48ca-97c6-06ed64fa95c1 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:09.419773 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-317b11a2-6dff-48ca-97c6-06ed64fa95c1 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:09.655909 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-317b11a2-6dff-48ca-97c6-06ed64fa95c1 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:40:09.665929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-317b11a2-6dff-48ca-97c6-06ed64fa95c1 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb" status: 200 len: 1313 microversion: 2.1 time: 0.262380 Feb 17 03:40:09.666932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 708/1422] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:40:09 2021] GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:40:10.684054 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8eb7ee03-32d9-479f-8e8f-e4ea70bfb42f tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:10.685496 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8eb7ee03-32d9-479f-8e8f-e4ea70bfb42f tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:10.711471 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8eb7ee03-32d9-479f-8e8f-e4ea70bfb42f tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:10.711471 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8eb7ee03-32d9-479f-8e8f-e4ea70bfb42f tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:10.711471 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8eb7ee03-32d9-479f-8e8f-e4ea70bfb42f tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:10.711471 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8eb7ee03-32d9-479f-8e8f-e4ea70bfb42f tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:11.269211 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8eb7ee03-32d9-479f-8e8f-e4ea70bfb42f tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:40:11.279137 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8eb7ee03-32d9-479f-8e8f-e4ea70bfb42f tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb" status: 200 len: 1497 microversion: 2.1 time: 0.599149 Feb 17 03:40:11.279755 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 715/1423] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:40:10 2021] GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb => generated 1497 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:40:12.186402 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ebea9ddb-0da0-4f8b-ad2a-400150951ef2 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:12.186974 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ebea9ddb-0da0-4f8b-ad2a-400150951ef2 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:12.195706 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ebea9ddb-0da0-4f8b-ad2a-400150951ef2 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:12.197483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ebea9ddb-0da0-4f8b-ad2a-400150951ef2 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:12.200173 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ebea9ddb-0da0-4f8b-ad2a-400150951ef2 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:12.200869 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ebea9ddb-0da0-4f8b-ad2a-400150951ef2 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:12.273966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ebea9ddb-0da0-4f8b-ad2a-400150951ef2 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] Going to try to terminate instance {{(pid=98103) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:40:12.408838 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ebea9ddb-0da0-4f8b-ad2a-400150951ef2 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "DELETE /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb" status: 204 len: 0 microversion: 2.1 time: 0.227272 Feb 17 03:40:12.410043 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 709/1424] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:40:12 2021] DELETE /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:40:12.419539 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f66a76af-8d40-4c30-bdb4-b0ff75217d81 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:12.420487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f66a76af-8d40-4c30-bdb4-b0ff75217d81 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:12.429115 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f66a76af-8d40-4c30-bdb4-b0ff75217d81 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:12.429903 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f66a76af-8d40-4c30-bdb4-b0ff75217d81 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:12.430905 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f66a76af-8d40-4c30-bdb4-b0ff75217d81 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:12.431542 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f66a76af-8d40-4c30-bdb4-b0ff75217d81 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:12.925080 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f66a76af-8d40-4c30-bdb4-b0ff75217d81 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:40:12.934881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f66a76af-8d40-4c30-bdb4-b0ff75217d81 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb" status: 200 len: 1503 microversion: 2.1 time: 0.519580 Feb 17 03:40:12.935595 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 716/1425] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:40:12 2021] GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb => generated 1503 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:40:13.955645 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ad7a0d99-481a-449d-bd06-3c4b52f368e7 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:13.956691 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ad7a0d99-481a-449d-bd06-3c4b52f368e7 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:13.965427 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad7a0d99-481a-449d-bd06-3c4b52f368e7 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:13.965938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad7a0d99-481a-449d-bd06-3c4b52f368e7 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:13.966795 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad7a0d99-481a-449d-bd06-3c4b52f368e7 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:13.967285 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ad7a0d99-481a-449d-bd06-3c4b52f368e7 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:14.205926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ad7a0d99-481a-449d-bd06-3c4b52f368e7 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:40:14.216117 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ad7a0d99-481a-449d-bd06-3c4b52f368e7 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb" status: 200 len: 1503 microversion: 2.1 time: 0.264943 Feb 17 03:40:14.216761 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 710/1426] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:40:13 2021] GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:40:15.210747 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-270e0d06-c0e3-477d-a1ef-231175325c4b req-8acbcb77-f797-4bbe-b6b6-82392149a361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b43b2a-76c7-475b-a6b4-244e05f28fbb", "name": "network-vif-deleted", "tag": "0eca2669-27fc-4ad4-9d65-39f38d830a3d"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:40:15.212438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:40:15.212438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:40:15.222185 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-270e0d06-c0e3-477d-a1ef-231175325c4b req-8acbcb77-f797-4bbe-b6b6-82392149a361 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:15.223128 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-270e0d06-c0e3-477d-a1ef-231175325c4b req-8acbcb77-f797-4bbe-b6b6-82392149a361 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:15.234932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-420fd6da-6ae4-4bdd-80ec-f4aaa6ef03a3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:15.235842 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-420fd6da-6ae4-4bdd-80ec-f4aaa6ef03a3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:15.244421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-270e0d06-c0e3-477d-a1ef-231175325c4b req-8acbcb77-f797-4bbe-b6b6-82392149a361 service nova] Creating event network-vif-deleted:0eca2669-27fc-4ad4-9d65-39f38d830a3d for instance 41b43b2a-76c7-475b-a6b4-244e05f28fbb on hv-cinder-75994 Feb 17 03:40:15.246168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-420fd6da-6ae4-4bdd-80ec-f4aaa6ef03a3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:15.246888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-420fd6da-6ae4-4bdd-80ec-f4aaa6ef03a3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:15.247905 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-420fd6da-6ae4-4bdd-80ec-f4aaa6ef03a3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:15.248560 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-420fd6da-6ae4-4bdd-80ec-f4aaa6ef03a3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:15.259557 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-270e0d06-c0e3-477d-a1ef-231175325c4b req-8acbcb77-f797-4bbe-b6b6-82392149a361 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043585 Feb 17 03:40:15.261978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 717/1427] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:40:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:40:15.384383 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-420fd6da-6ae4-4bdd-80ec-f4aaa6ef03a3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e23a58031d401b84f2b344cfc83dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aea9cb666780439b80fcb18514f32228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:40:15.395324 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-420fd6da-6ae4-4bdd-80ec-f4aaa6ef03a3 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb" status: 200 len: 1298 microversion: 2.1 time: 0.163679 Feb 17 03:40:15.395812 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 711/1428] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:40:15 2021] GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb => generated 1298 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:40:16.414269 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f6bf9b7d-12f5-4ec2-95aa-afa99c1db973 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:40:16.415139 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f6bf9b7d-12f5-4ec2-95aa-afa99c1db973 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] [instance: 41b43b2a-76c7-475b-a6b4-244e05f28fbb] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:40:16.423481 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6bf9b7d-12f5-4ec2-95aa-afa99c1db973 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:16.424252 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6bf9b7d-12f5-4ec2-95aa-afa99c1db973 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:16.425352 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6bf9b7d-12f5-4ec2-95aa-afa99c1db973 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:40:16.426191 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f6bf9b7d-12f5-4ec2-95aa-afa99c1db973 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:40:16.482639 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-f6bf9b7d-12f5-4ec2-95aa-afa99c1db973 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] HTTP exception thrown: Instance 41b43b2a-76c7-475b-a6b4-244e05f28fbb could not be found. Feb 17 03:40:16.483323 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f6bf9b7d-12f5-4ec2-95aa-afa99c1db973 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] Returning 404 to user: Instance 41b43b2a-76c7-475b-a6b4-244e05f28fbb could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:40:16.485888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f6bf9b7d-12f5-4ec2-95aa-afa99c1db973 tempest-VolumesActionsTest-2073840464 tempest-VolumesActionsTest-2073840464-project] 10.222.0.57 "GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb" status: 404 len: 111 microversion: 2.1 time: 0.074927 Feb 17 03:40:16.485888 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 718/1429] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:40:16 2021] GET /compute/v2.1/servers/41b43b2a-76c7-475b-a6b4-244e05f28fbb => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:40:44.516574 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:40:44.517347 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:40:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:41:09.993966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6a1e8d48-00c7-4bd5-bb23-5a3aa514d009 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '.version_select at 0x7f98b0407488>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:10.528209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6a1e8d48-00c7-4bd5-bb23-5a3aa514d009 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:10.537996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6a1e8d48-00c7-4bd5-bb23-5a3aa514d009 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:10.538506 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6a1e8d48-00c7-4bd5-bb23-5a3aa514d009 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:10.539395 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6a1e8d48-00c7-4bd5-bb23-5a3aa514d009 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:10.539895 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6a1e8d48-00c7-4bd5-bb23-5a3aa514d009 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:10.608681 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6a1e8d48-00c7-4bd5-bb23-5a3aa514d009 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Acquired lock "refresh_cache-1f8f18c7-f615-4522-86f3-7d9caae10cb0" {{(pid=98103) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:41:12.753955 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-6a1e8d48-00c7-4bd5-bb23-5a3aa514d009 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 03:41:12.943429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-0da9f04d-bac3-4237-b562-5bcd619c45a2 req-6e9745bc-911a-48f6-aff6-20b4b6c67b85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f8f18c7-f615-4522-86f3-7d9caae10cb0", "tag": "3b32b96c-a86d-446f-8f9f-4f8b2c500fb9"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:41:12.945289 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:41:12.945289 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:41:12.955187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-0da9f04d-bac3-4237-b562-5bcd619c45a2 req-6e9745bc-911a-48f6-aff6-20b4b6c67b85 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:12.955787 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-0da9f04d-bac3-4237-b562-5bcd619c45a2 req-6e9745bc-911a-48f6-aff6-20b4b6c67b85 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:12.975248 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-0da9f04d-bac3-4237-b562-5bcd619c45a2 req-6e9745bc-911a-48f6-aff6-20b4b6c67b85 service nova] Creating event network-changed:3b32b96c-a86d-446f-8f9f-4f8b2c500fb9 for instance 1f8f18c7-f615-4522-86f3-7d9caae10cb0 on hv-cinder-75994 Feb 17 03:41:12.980872 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-0da9f04d-bac3-4237-b562-5bcd619c45a2 req-6e9745bc-911a-48f6-aff6-20b4b6c67b85 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220841 Feb 17 03:41:12.981559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 719/1430] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:41:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:41:13.715701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-6a1e8d48-00c7-4bd5-bb23-5a3aa514d009 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Updating instance_info_cache with network_info: [{"id": "3b32b96c-a86d-446f-8f9f-4f8b2c500fb9", "address": "fa:16:3e:49:63:04", "network": {"id": "3cb0cdf3-e2d2-4fae-b226-b086c7cc05ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1162730446-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "09f977ccc1e54aa6bfffd127c9a4be7d", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap3b32b96c-a8", "ovs_interfaceid": "3b32b96c-a86d-446f-8f9f-4f8b2c500fb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 03:41:13.726651 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6a1e8d48-00c7-4bd5-bb23-5a3aa514d009 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Releasing lock "refresh_cache-1f8f18c7-f615-4522-86f3-7d9caae10cb0" {{(pid=98103) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:41:13.727597 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6a1e8d48-00c7-4bd5-bb23-5a3aa514d009 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/9e6d4017-6793-4f64-8282-5e78c6d3e10f" status: 202 len: 0 microversion: 2.1 time: 3.738789 Feb 17 03:41:13.728242 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 712/1431] 10.222.0.57 () {58 vars in 1253 bytes} [Wed Feb 17 03:41:09 2021] DELETE /compute/v2.1/os-floating-ips/9e6d4017-6793-4f64-8282-5e78c6d3e10f => generated 0 bytes in 3740 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:41:13.737636 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9631477f-801b-43fd-94c5-63928e0bdb91 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:13.738289 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9631477f-801b-43fd-94c5-63928e0bdb91 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:13.747125 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9631477f-801b-43fd-94c5-63928e0bdb91 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:13.747631 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9631477f-801b-43fd-94c5-63928e0bdb91 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:13.748489 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9631477f-801b-43fd-94c5-63928e0bdb91 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:13.748986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9631477f-801b-43fd-94c5-63928e0bdb91 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:13.816593 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9631477f-801b-43fd-94c5-63928e0bdb91 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Going to try to terminate instance {{(pid=98104) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:41:13.954644 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9631477f-801b-43fd-94c5-63928e0bdb91 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 204 len: 0 microversion: 2.1 time: 0.221202 Feb 17 03:41:13.955446 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 720/1432] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:41:13 2021] DELETE /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:41:13.969546 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ac706c29-260c-4320-83ca-e56debfcfd0c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:13.970728 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ac706c29-260c-4320-83ca-e56debfcfd0c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:13.986138 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac706c29-260c-4320-83ca-e56debfcfd0c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:13.986998 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac706c29-260c-4320-83ca-e56debfcfd0c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:13.988561 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac706c29-260c-4320-83ca-e56debfcfd0c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:13.989527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ac706c29-260c-4320-83ca-e56debfcfd0c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:14.276616 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ac706c29-260c-4320-83ca-e56debfcfd0c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:14.286262 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ac706c29-260c-4320-83ca-e56debfcfd0c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1465 microversion: 2.1 time: 0.324367 Feb 17 03:41:14.286873 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 713/1433] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:13 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1465 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:15.305809 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5368265c-baf1-412b-a1d6-744c485d0907 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:15.306836 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5368265c-baf1-412b-a1d6-744c485d0907 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:15.315071 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5368265c-baf1-412b-a1d6-744c485d0907 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:15.315577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5368265c-baf1-412b-a1d6-744c485d0907 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:15.316420 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5368265c-baf1-412b-a1d6-744c485d0907 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:15.316908 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5368265c-baf1-412b-a1d6-744c485d0907 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:15.635382 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5368265c-baf1-412b-a1d6-744c485d0907 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:15.643162 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5368265c-baf1-412b-a1d6-744c485d0907 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1465 microversion: 2.1 time: 0.341857 Feb 17 03:41:15.643782 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 721/1434] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:15 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1465 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:16.662573 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fddbbacc-2a88-4b63-9eea-73cd5fe59ca8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:16.663286 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fddbbacc-2a88-4b63-9eea-73cd5fe59ca8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:16.671403 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fddbbacc-2a88-4b63-9eea-73cd5fe59ca8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:16.671910 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fddbbacc-2a88-4b63-9eea-73cd5fe59ca8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:16.672758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fddbbacc-2a88-4b63-9eea-73cd5fe59ca8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:16.673278 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fddbbacc-2a88-4b63-9eea-73cd5fe59ca8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:16.896298 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-fddbbacc-2a88-4b63-9eea-73cd5fe59ca8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:16.905853 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fddbbacc-2a88-4b63-9eea-73cd5fe59ca8 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1465 microversion: 2.1 time: 0.247911 Feb 17 03:41:16.906466 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 714/1435] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:16 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1465 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:17.924558 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f35814ce-f024-4720-955f-7a801af12fbc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:17.925339 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f35814ce-f024-4720-955f-7a801af12fbc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:17.933672 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f35814ce-f024-4720-955f-7a801af12fbc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:17.934093 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f35814ce-f024-4720-955f-7a801af12fbc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:17.934935 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f35814ce-f024-4720-955f-7a801af12fbc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:17.935424 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f35814ce-f024-4720-955f-7a801af12fbc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:18.684841 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f35814ce-f024-4720-955f-7a801af12fbc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:18.694110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f35814ce-f024-4720-955f-7a801af12fbc tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1465 microversion: 2.1 time: 0.773497 Feb 17 03:41:18.694957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 722/1436] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:17 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1465 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:18.997245 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-fee490bf-d980-4753-bde6-674f3b7cf084 req-33c93af7-8daa-43ce-bd75-d33bd3d32850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f8f18c7-f615-4522-86f3-7d9caae10cb0", "name": "network-vif-deleted", "tag": "3b32b96c-a86d-446f-8f9f-4f8b2c500fb9"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:41:18.999189 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:41:18.999189 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:41:19.009373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-fee490bf-d980-4753-bde6-674f3b7cf084 req-33c93af7-8daa-43ce-bd75-d33bd3d32850 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:19.009886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-fee490bf-d980-4753-bde6-674f3b7cf084 req-33c93af7-8daa-43ce-bd75-d33bd3d32850 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:19.029631 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-fee490bf-d980-4753-bde6-674f3b7cf084 req-33c93af7-8daa-43ce-bd75-d33bd3d32850 service nova] Creating event network-vif-deleted:3b32b96c-a86d-446f-8f9f-4f8b2c500fb9 for instance 1f8f18c7-f615-4522-86f3-7d9caae10cb0 on hv-cinder-75994 Feb 17 03:41:19.034739 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-fee490bf-d980-4753-bde6-674f3b7cf084 req-33c93af7-8daa-43ce-bd75-d33bd3d32850 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041650 Feb 17 03:41:19.035407 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 715/1437] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:41:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:41:19.713172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-30ff6058-9236-42ea-923e-5ad1c1a6a825 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:19.713801 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-30ff6058-9236-42ea-923e-5ad1c1a6a825 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:19.722571 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30ff6058-9236-42ea-923e-5ad1c1a6a825 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:19.723076 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30ff6058-9236-42ea-923e-5ad1c1a6a825 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:19.723935 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30ff6058-9236-42ea-923e-5ad1c1a6a825 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:19.724434 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-30ff6058-9236-42ea-923e-5ad1c1a6a825 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:19.872760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-30ff6058-9236-42ea-923e-5ad1c1a6a825 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:19.883219 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-30ff6058-9236-42ea-923e-5ad1c1a6a825 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1225 microversion: 2.1 time: 0.174245 Feb 17 03:41:19.883826 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 723/1438] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:19 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1225 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:20.903606 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-eccd2e72-e4d3-465c-bd50-dbe87e9d609e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:20.904331 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-eccd2e72-e4d3-465c-bd50-dbe87e9d609e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:20.913521 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eccd2e72-e4d3-465c-bd50-dbe87e9d609e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:20.914040 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eccd2e72-e4d3-465c-bd50-dbe87e9d609e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:20.914907 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eccd2e72-e4d3-465c-bd50-dbe87e9d609e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:20.915401 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eccd2e72-e4d3-465c-bd50-dbe87e9d609e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:21.049400 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-eccd2e72-e4d3-465c-bd50-dbe87e9d609e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:21.058974 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-eccd2e72-e4d3-465c-bd50-dbe87e9d609e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 200 len: 1225 microversion: 2.1 time: 0.159925 Feb 17 03:41:21.059747 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 716/1439] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:20 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 1225 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:22.078333 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-612c45b7-b3ed-4eeb-8528-5f4a26b9ae5e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:22.079250 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-612c45b7-b3ed-4eeb-8528-5f4a26b9ae5e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 1f8f18c7-f615-4522-86f3-7d9caae10cb0] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:22.088207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-612c45b7-b3ed-4eeb-8528-5f4a26b9ae5e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:22.088921 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-612c45b7-b3ed-4eeb-8528-5f4a26b9ae5e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:22.089600 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-612c45b7-b3ed-4eeb-8528-5f4a26b9ae5e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:22.090072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-612c45b7-b3ed-4eeb-8528-5f4a26b9ae5e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:22.145710 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-612c45b7-b3ed-4eeb-8528-5f4a26b9ae5e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] HTTP exception thrown: Instance 1f8f18c7-f615-4522-86f3-7d9caae10cb0 could not be found. Feb 17 03:41:22.146386 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-612c45b7-b3ed-4eeb-8528-5f4a26b9ae5e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Returning 404 to user: Instance 1f8f18c7-f615-4522-86f3-7d9caae10cb0 could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:41:22.147435 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-612c45b7-b3ed-4eeb-8528-5f4a26b9ae5e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0" status: 404 len: 111 microversion: 2.1 time: 0.073919 Feb 17 03:41:22.148376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 724/1440] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:22 2021] GET /compute/v2.1/servers/1f8f18c7-f615-4522-86f3-7d9caae10cb0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:41:24.706316 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-61392a32-27bd-471e-bac8-268bd206cf96 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '.version_select at 0x7f98b02c80d0>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:25.231866 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-61392a32-27bd-471e-bac8-268bd206cf96 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:25.240004 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-61392a32-27bd-471e-bac8-268bd206cf96 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:25.240513 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-61392a32-27bd-471e-bac8-268bd206cf96 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:25.241411 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-61392a32-27bd-471e-bac8-268bd206cf96 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:25.241914 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-61392a32-27bd-471e-bac8-268bd206cf96 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:25.306516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-61392a32-27bd-471e-bac8-268bd206cf96 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Acquired lock "refresh_cache-43a647e7-a66d-4254-9011-71ced47c3312" {{(pid=98103) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:41:27.146924 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-61392a32-27bd-471e-bac8-268bd206cf96 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 03:41:27.156465 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-905392dc-1df4-4dc4-8386-5dde495558d5 req-f8c086ec-932b-4e5d-ac90-0c115e5563f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a647e7-a66d-4254-9011-71ced47c3312", "tag": "1eaf9637-4a5d-4be5-9bed-fd22ccba8da3"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:41:27.158150 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:41:27.158150 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:41:27.167898 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-905392dc-1df4-4dc4-8386-5dde495558d5 req-f8c086ec-932b-4e5d-ac90-0c115e5563f0 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:27.168395 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-905392dc-1df4-4dc4-8386-5dde495558d5 req-f8c086ec-932b-4e5d-ac90-0c115e5563f0 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:27.187967 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-905392dc-1df4-4dc4-8386-5dde495558d5 req-f8c086ec-932b-4e5d-ac90-0c115e5563f0 service nova] Creating event network-changed:1eaf9637-4a5d-4be5-9bed-fd22ccba8da3 for instance 43a647e7-a66d-4254-9011-71ced47c3312 on hv-cinder-75994 Feb 17 03:41:27.197876 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-905392dc-1df4-4dc4-8386-5dde495558d5 req-f8c086ec-932b-4e5d-ac90-0c115e5563f0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045438 Feb 17 03:41:27.198808 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 725/1441] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:41:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:41:28.240232 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-61392a32-27bd-471e-bac8-268bd206cf96 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Updating instance_info_cache with network_info: [{"id": "1eaf9637-4a5d-4be5-9bed-fd22ccba8da3", "address": "fa:16:3e:07:db:cc", "network": {"id": "3cb0cdf3-e2d2-4fae-b226-b086c7cc05ee", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1162730446-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "09f977ccc1e54aa6bfffd127c9a4be7d", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap1eaf9637-4a", "ovs_interfaceid": "1eaf9637-4a5d-4be5-9bed-fd22ccba8da3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 03:41:28.254401 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-61392a32-27bd-471e-bac8-268bd206cf96 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Releasing lock "refresh_cache-43a647e7-a66d-4254-9011-71ced47c3312" {{(pid=98103) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:41:28.255340 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-61392a32-27bd-471e-bac8-268bd206cf96 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/41ac491b-7a8b-44d5-bac1-8f755fc274fe" status: 202 len: 0 microversion: 2.1 time: 3.553121 Feb 17 03:41:28.255988 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 717/1442] 10.222.0.57 () {58 vars in 1253 bytes} [Wed Feb 17 03:41:24 2021] DELETE /compute/v2.1/os-floating-ips/41ac491b-7a8b-44d5-bac1-8f755fc274fe => generated 0 bytes in 3554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:41:28.266817 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1eefd0a4-c317-4151-ab16-dd8300ebaf45 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:28.267467 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1eefd0a4-c317-4151-ab16-dd8300ebaf45 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:28.279643 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1eefd0a4-c317-4151-ab16-dd8300ebaf45 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:28.280676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1eefd0a4-c317-4151-ab16-dd8300ebaf45 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:28.282137 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1eefd0a4-c317-4151-ab16-dd8300ebaf45 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:28.282886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1eefd0a4-c317-4151-ab16-dd8300ebaf45 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:28.362003 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1eefd0a4-c317-4151-ab16-dd8300ebaf45 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Going to try to terminate instance {{(pid=98104) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:41:28.523926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1eefd0a4-c317-4151-ab16-dd8300ebaf45 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "DELETE /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 204 len: 0 microversion: 2.1 time: 0.262587 Feb 17 03:41:28.525062 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 726/1443] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:41:28 2021] DELETE /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:41:28.539041 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4839500a-ee37-4baf-93be-d84dd4cd3d46 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:28.540148 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4839500a-ee37-4baf-93be-d84dd4cd3d46 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:28.554596 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4839500a-ee37-4baf-93be-d84dd4cd3d46 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:28.555464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4839500a-ee37-4baf-93be-d84dd4cd3d46 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:28.557014 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4839500a-ee37-4baf-93be-d84dd4cd3d46 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:28.558165 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4839500a-ee37-4baf-93be-d84dd4cd3d46 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:28.801796 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4839500a-ee37-4baf-93be-d84dd4cd3d46 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:28.811421 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4839500a-ee37-4baf-93be-d84dd4cd3d46 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1464 microversion: 2.1 time: 0.280151 Feb 17 03:41:28.812167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 718/1444] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:28 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1464 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:29.831462 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8ebfa57c-0e8f-41e0-9fe0-2538276a45e6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:29.832180 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8ebfa57c-0e8f-41e0-9fe0-2538276a45e6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:29.840498 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ebfa57c-0e8f-41e0-9fe0-2538276a45e6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:29.841002 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ebfa57c-0e8f-41e0-9fe0-2538276a45e6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:29.841875 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ebfa57c-0e8f-41e0-9fe0-2538276a45e6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:29.842359 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8ebfa57c-0e8f-41e0-9fe0-2538276a45e6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:30.070600 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8ebfa57c-0e8f-41e0-9fe0-2538276a45e6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:30.088770 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8ebfa57c-0e8f-41e0-9fe0-2538276a45e6 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1464 microversion: 2.1 time: 0.261268 Feb 17 03:41:30.089882 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 727/1445] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:29 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1464 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:31.108312 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b8b104ed-85d0-48ef-bbb5-c25891b33349 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:31.108978 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b8b104ed-85d0-48ef-bbb5-c25891b33349 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:31.117562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b8b104ed-85d0-48ef-bbb5-c25891b33349 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:31.118067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b8b104ed-85d0-48ef-bbb5-c25891b33349 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:31.118900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b8b104ed-85d0-48ef-bbb5-c25891b33349 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:31.119387 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b8b104ed-85d0-48ef-bbb5-c25891b33349 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:31.330557 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b8b104ed-85d0-48ef-bbb5-c25891b33349 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:31.340314 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b8b104ed-85d0-48ef-bbb5-c25891b33349 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1464 microversion: 2.1 time: 0.236035 Feb 17 03:41:31.340941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 719/1446] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:31 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1464 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:32.359607 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-92f2b9ca-f2b0-4eb4-8d2a-6088233cc599 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:32.360199 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-92f2b9ca-f2b0-4eb4-8d2a-6088233cc599 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:32.368103 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-92f2b9ca-f2b0-4eb4-8d2a-6088233cc599 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:32.368619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-92f2b9ca-f2b0-4eb4-8d2a-6088233cc599 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:32.369494 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-92f2b9ca-f2b0-4eb4-8d2a-6088233cc599 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:32.369982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-92f2b9ca-f2b0-4eb4-8d2a-6088233cc599 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:32.583093 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-92f2b9ca-f2b0-4eb4-8d2a-6088233cc599 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:32.592000 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-92f2b9ca-f2b0-4eb4-8d2a-6088233cc599 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1464 microversion: 2.1 time: 0.236581 Feb 17 03:41:32.592737 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 728/1447] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:32 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1464 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:33.610483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-13868caa-4a1d-43a0-b179-950e81fa84b5 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:33.611093 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-13868caa-4a1d-43a0-b179-950e81fa84b5 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:33.619089 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-13868caa-4a1d-43a0-b179-950e81fa84b5 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:33.621238 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-13868caa-4a1d-43a0-b179-950e81fa84b5 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:33.621238 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-13868caa-4a1d-43a0-b179-950e81fa84b5 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:33.621238 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-13868caa-4a1d-43a0-b179-950e81fa84b5 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:33.842992 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-13868caa-4a1d-43a0-b179-950e81fa84b5 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:33.853734 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-13868caa-4a1d-43a0-b179-950e81fa84b5 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1464 microversion: 2.1 time: 0.246349 Feb 17 03:41:33.853734 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 720/1448] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:33 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1464 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:34.871094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4c2e45f3-8983-4bba-803d-77974aefad45 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:34.872439 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4c2e45f3-8983-4bba-803d-77974aefad45 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:34.881787 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c2e45f3-8983-4bba-803d-77974aefad45 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:34.882388 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c2e45f3-8983-4bba-803d-77974aefad45 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:34.883314 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c2e45f3-8983-4bba-803d-77974aefad45 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:34.883881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c2e45f3-8983-4bba-803d-77974aefad45 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:35.112558 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4c2e45f3-8983-4bba-803d-77974aefad45 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:35.122174 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4c2e45f3-8983-4bba-803d-77974aefad45 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1464 microversion: 2.1 time: 0.255993 Feb 17 03:41:35.123009 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 729/1449] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:34 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1464 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:35.876635 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-4eb80ffc-1d54-4193-ac1c-edb595c82b96 req-50038c68-6b2b-461c-8448-be028c067c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a647e7-a66d-4254-9011-71ced47c3312", "name": "network-vif-unplugged", "status": "completed", "tag": "1eaf9637-4a5d-4be5-9bed-fd22ccba8da3"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:41:35.880104 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:41:35.880104 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:41:35.889585 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-4eb80ffc-1d54-4193-ac1c-edb595c82b96 req-50038c68-6b2b-461c-8448-be028c067c90 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:35.890139 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-4eb80ffc-1d54-4193-ac1c-edb595c82b96 req-50038c68-6b2b-461c-8448-be028c067c90 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:35.909813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-4eb80ffc-1d54-4193-ac1c-edb595c82b96 req-50038c68-6b2b-461c-8448-be028c067c90 service nova] Creating event network-vif-unplugged:1eaf9637-4a5d-4be5-9bed-fd22ccba8da3 for instance 43a647e7-a66d-4254-9011-71ced47c3312 on hv-cinder-75994 Feb 17 03:41:35.916349 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-4eb80ffc-1d54-4193-ac1c-edb595c82b96 req-50038c68-6b2b-461c-8448-be028c067c90 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044342 Feb 17 03:41:35.917248 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 721/1450] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:41:35 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:41:36.140356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-38bf7446-1a69-4ea8-8507-73d6562e31ef tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:36.141089 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-38bf7446-1a69-4ea8-8507-73d6562e31ef tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:36.149725 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-38bf7446-1a69-4ea8-8507-73d6562e31ef tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:36.150288 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-38bf7446-1a69-4ea8-8507-73d6562e31ef tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:36.151236 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-38bf7446-1a69-4ea8-8507-73d6562e31ef tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:36.151830 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-38bf7446-1a69-4ea8-8507-73d6562e31ef tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:36.373701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-38bf7446-1a69-4ea8-8507-73d6562e31ef tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:36.383344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-38bf7446-1a69-4ea8-8507-73d6562e31ef tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1464 microversion: 2.1 time: 0.246976 Feb 17 03:41:36.384268 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 730/1451] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:36 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1464 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:37.407107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-38e6d65a-d795-499b-9fbe-d2b903089e52 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:37.408418 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-38e6d65a-d795-499b-9fbe-d2b903089e52 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:37.417565 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-38e6d65a-d795-499b-9fbe-d2b903089e52 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:37.418069 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-38e6d65a-d795-499b-9fbe-d2b903089e52 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:37.418918 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-38e6d65a-d795-499b-9fbe-d2b903089e52 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:37.419408 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-38e6d65a-d795-499b-9fbe-d2b903089e52 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:37.665010 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-38e6d65a-d795-499b-9fbe-d2b903089e52 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:37.675440 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-38e6d65a-d795-499b-9fbe-d2b903089e52 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1464 microversion: 2.1 time: 0.276385 Feb 17 03:41:37.676452 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 722/1452] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:37 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1464 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:41:38.696306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-cac3d0c9-492e-40b6-b28e-925be166394a tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:38.696964 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-cac3d0c9-492e-40b6-b28e-925be166394a tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:38.705479 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cac3d0c9-492e-40b6-b28e-925be166394a tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:38.705991 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cac3d0c9-492e-40b6-b28e-925be166394a tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:38.706845 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cac3d0c9-492e-40b6-b28e-925be166394a tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:38.708024 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-cac3d0c9-492e-40b6-b28e-925be166394a tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:38.950045 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-cac3d0c9-492e-40b6-b28e-925be166394a tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:38.960487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-cac3d0c9-492e-40b6-b28e-925be166394a tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1464 microversion: 2.1 time: 0.268912 Feb 17 03:41:38.961779 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 731/1453] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:38 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1464 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:39.980506 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1505d805-957a-44e1-a0d3-db0af31dbacf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:39.983108 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1505d805-957a-44e1-a0d3-db0af31dbacf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:39.993385 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1505d805-957a-44e1-a0d3-db0af31dbacf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:39.994221 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1505d805-957a-44e1-a0d3-db0af31dbacf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:39.995350 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1505d805-957a-44e1-a0d3-db0af31dbacf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:39.996058 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1505d805-957a-44e1-a0d3-db0af31dbacf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:40.147698 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1505d805-957a-44e1-a0d3-db0af31dbacf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:40.158016 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1505d805-957a-44e1-a0d3-db0af31dbacf tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1390 microversion: 2.1 time: 0.181961 Feb 17 03:41:40.158587 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 723/1454] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:39 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1390 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:40.481410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-674f5e9c-e94d-42a8-989e-113599a24386 req-61dec9ee-f79c-46a3-89eb-f7b0f8a7b26f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a647e7-a66d-4254-9011-71ced47c3312", "name": "network-vif-deleted", "tag": "1eaf9637-4a5d-4be5-9bed-fd22ccba8da3"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:41:40.483522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:41:40.483522 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:41:40.493521 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-674f5e9c-e94d-42a8-989e-113599a24386 req-61dec9ee-f79c-46a3-89eb-f7b0f8a7b26f service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:40.494123 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-674f5e9c-e94d-42a8-989e-113599a24386 req-61dec9ee-f79c-46a3-89eb-f7b0f8a7b26f service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:40.527565 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-674f5e9c-e94d-42a8-989e-113599a24386 req-61dec9ee-f79c-46a3-89eb-f7b0f8a7b26f service nova] Creating event network-vif-deleted:1eaf9637-4a5d-4be5-9bed-fd22ccba8da3 for instance 43a647e7-a66d-4254-9011-71ced47c3312 on hv-cinder-75994 Feb 17 03:41:40.533447 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-674f5e9c-e94d-42a8-989e-113599a24386 req-61dec9ee-f79c-46a3-89eb-f7b0f8a7b26f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055820 Feb 17 03:41:40.534753 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 732/1455] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:41:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:41:41.175855 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ec6d83b0-52d7-41e2-b547-b61213e20f6e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:41.176523 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ec6d83b0-52d7-41e2-b547-b61213e20f6e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:41.191280 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ec6d83b0-52d7-41e2-b547-b61213e20f6e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:41.191947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ec6d83b0-52d7-41e2-b547-b61213e20f6e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:41.192970 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ec6d83b0-52d7-41e2-b547-b61213e20f6e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:41.193508 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ec6d83b0-52d7-41e2-b547-b61213e20f6e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:41.271203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ec6d83b0-52d7-41e2-b547-b61213e20f6e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:41.271899 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ec6d83b0-52d7-41e2-b547-b61213e20f6e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:41.272406 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-ec6d83b0-52d7-41e2-b547-b61213e20f6e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lazy-loading 'fault' on Instance uuid 43a647e7-a66d-4254-9011-71ced47c3312 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:41:41.339847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ec6d83b0-52d7-41e2-b547-b61213e20f6e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c16fada80664e0cb2bc0031171b6c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f977ccc1e54aa6bfffd127c9a4be7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:41.349467 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ec6d83b0-52d7-41e2-b547-b61213e20f6e tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 200 len: 1229 microversion: 2.1 time: 0.177412 Feb 17 03:41:41.350215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 724/1456] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:41 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 1229 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:42.369480 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6f5386a8-12ff-4efa-b4ba-23b8a0e3b749 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:42.370182 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6f5386a8-12ff-4efa-b4ba-23b8a0e3b749 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: 43a647e7-a66d-4254-9011-71ced47c3312] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:42.378569 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6f5386a8-12ff-4efa-b4ba-23b8a0e3b749 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:42.379580 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6f5386a8-12ff-4efa-b4ba-23b8a0e3b749 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:42.380422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6f5386a8-12ff-4efa-b4ba-23b8a0e3b749 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:42.380919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6f5386a8-12ff-4efa-b4ba-23b8a0e3b749 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:42.436039 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-6f5386a8-12ff-4efa-b4ba-23b8a0e3b749 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] HTTP exception thrown: Instance 43a647e7-a66d-4254-9011-71ced47c3312 could not be found. Feb 17 03:41:42.436708 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6f5386a8-12ff-4efa-b4ba-23b8a0e3b749 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Returning 404 to user: Instance 43a647e7-a66d-4254-9011-71ced47c3312 could not be found. {{(pid=98104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:41:42.437642 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6f5386a8-12ff-4efa-b4ba-23b8a0e3b749 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312" status: 404 len: 111 microversion: 2.1 time: 0.072921 Feb 17 03:41:42.438249 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 733/1457] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:42 2021] GET /compute/v2.1/servers/43a647e7-a66d-4254-9011-71ced47c3312 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:41:42.447527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-eb2876d3-ad26-4aa8-80d3-8d541b7d4d1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '.version_select at 0x7f98b0407400>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:43.342135 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-07b142e3-32f4-4c73-879c-a051e3bfcf44 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1098425408", "imageRef": "27891a64-31b3-4754-87b4-bf609a12c59a", "flavorRef": "452"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:41:43.408001 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-07b142e3-32f4-4c73-879c-a051e3bfcf44 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] validate_networks() for None {{(pid=98104) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:41:43.694135 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-07b142e3-32f4-4c73-879c-a051e3bfcf44 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Flavor limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:41:43.694741 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-07b142e3-32f4-4c73-879c-a051e3bfcf44 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Image limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:41:43.695293 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-07b142e3-32f4-4c73-879c-a051e3bfcf44 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Flavor pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:41:43.695756 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-07b142e3-32f4-4c73-879c-a051e3bfcf44 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Image pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:41:43.696259 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-07b142e3-32f4-4c73-879c-a051e3bfcf44 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:41:43.705629 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07b142e3-32f4-4c73-879c-a051e3bfcf44 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:43.706136 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07b142e3-32f4-4c73-879c-a051e3bfcf44 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:43.707008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07b142e3-32f4-4c73-879c-a051e3bfcf44 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:43.708108 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-07b142e3-32f4-4c73-879c-a051e3bfcf44 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:43.726693 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-07b142e3-32f4-4c73-879c-a051e3bfcf44 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Getting quotas for project c3b1de2d733f40e280136eb9fa396503. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:41:43.731109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-07b142e3-32f4-4c73-879c-a051e3bfcf44 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Getting quotas for user 943f64de44d9455f9cba647492b8694c and project c3b1de2d733f40e280136eb9fa396503. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:41:43.742308 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-07b142e3-32f4-4c73-879c-a051e3bfcf44 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Going to run 1 instances... {{(pid=98104) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:41:43.744897 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-07b142e3-32f4-4c73-879c-a051e3bfcf44 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='27891a64-31b3-4754-87b4-bf609a12c59a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:41:43.797052 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-07b142e3-32f4-4c73-879c-a051e3bfcf44 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.457549 Feb 17 03:41:43.797052 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 734/1458] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:41:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:41:43.806330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-eb2876d3-ad26-4aa8-80d3-8d541b7d4d1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/21a4f781-2646-4d12-8fd9-9bebcdd8aa5f" status: 202 len: 0 microversion: 2.1 time: 1.362668 Feb 17 03:41:43.806958 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 725/1459] 10.222.0.57 () {58 vars in 1253 bytes} [Wed Feb 17 03:41:42 2021] DELETE /compute/v2.1/os-floating-ips/21a4f781-2646-4d12-8fd9-9bebcdd8aa5f => generated 0 bytes in 1364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:41:43.808666 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-3b32e96c-bcbe-4327-9536-dbc3c932a069 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:43.809426 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-3b32e96c-bcbe-4327-9536-dbc3c932a069 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:43.815497 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1aae8c0a-880d-4c7b-aae8-10cd4b196b1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:43.816050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1aae8c0a-880d-4c7b-aae8-10cd4b196b1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:43.825673 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1aae8c0a-880d-4c7b-aae8-10cd4b196b1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:43.826187 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1aae8c0a-880d-4c7b-aae8-10cd4b196b1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:43.827034 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1aae8c0a-880d-4c7b-aae8-10cd4b196b1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:43.827525 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1aae8c0a-880d-4c7b-aae8-10cd4b196b1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:43.883352 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-1aae8c0a-880d-4c7b-aae8-10cd4b196b1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] HTTP exception thrown: Instance ce920548-efb2-455b-a260-d9b321d73cd9 could not be found. Feb 17 03:41:43.884031 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1aae8c0a-880d-4c7b-aae8-10cd4b196b1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Returning 404 to user: Instance ce920548-efb2-455b-a260-d9b321d73cd9 could not be found. {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:41:43.884949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1aae8c0a-880d-4c7b-aae8-10cd4b196b1c tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 404 len: 111 microversion: 2.1 time: 0.073441 Feb 17 03:41:43.885577 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 726/1460] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:41:43 2021] DELETE /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:41:43.894326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-15378c2e-69a3-40ae-a84b-cfd3d88d6038 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:43.895501 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-3b32e96c-bcbe-4327-9536-dbc3c932a069 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943f64de44d9455f9cba647492b8694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1de2d733f40e280136eb9fa396503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:43.895980 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-15378c2e-69a3-40ae-a84b-cfd3d88d6038 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] [instance: ce920548-efb2-455b-a260-d9b321d73cd9] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:43.904473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-15378c2e-69a3-40ae-a84b-cfd3d88d6038 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:43.905379 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-15378c2e-69a3-40ae-a84b-cfd3d88d6038 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:43.905661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-3b32e96c-bcbe-4327-9536-dbc3c932a069 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] 10.222.0.57 "GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc" status: 200 len: 1215 microversion: 2.1 time: 0.102425 Feb 17 03:41:43.906440 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 735/1461] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:43 2021] GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:43.907069 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-15378c2e-69a3-40ae-a84b-cfd3d88d6038 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:43.907732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-15378c2e-69a3-40ae-a84b-cfd3d88d6038 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:43.966159 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-15378c2e-69a3-40ae-a84b-cfd3d88d6038 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] HTTP exception thrown: Instance ce920548-efb2-455b-a260-d9b321d73cd9 could not be found. Feb 17 03:41:43.966837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-15378c2e-69a3-40ae-a84b-cfd3d88d6038 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Returning 404 to user: Instance ce920548-efb2-455b-a260-d9b321d73cd9 could not be found. {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:41:43.967781 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-15378c2e-69a3-40ae-a84b-cfd3d88d6038 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9" status: 404 len: 111 microversion: 2.1 time: 0.077699 Feb 17 03:41:43.968553 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 727/1462] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:43 2021] GET /compute/v2.1/servers/ce920548-efb2-455b-a260-d9b321d73cd9 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 17 03:41:44.924078 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1a821d5e-bc29-40fb-9941-48151252d7dd tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:44.924777 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1a821d5e-bc29-40fb-9941-48151252d7dd tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:44.934616 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1a821d5e-bc29-40fb-9941-48151252d7dd tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:44.934837 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1a821d5e-bc29-40fb-9941-48151252d7dd tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:44.935755 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1a821d5e-bc29-40fb-9941-48151252d7dd tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:44.936351 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1a821d5e-bc29-40fb-9941-48151252d7dd tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:45.119966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1a821d5e-bc29-40fb-9941-48151252d7dd tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943f64de44d9455f9cba647492b8694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1de2d733f40e280136eb9fa396503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:45.128827 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1a821d5e-bc29-40fb-9941-48151252d7dd tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] 10.222.0.57 "GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc" status: 200 len: 1275 microversion: 2.1 time: 0.208802 Feb 17 03:41:45.129547 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 736/1463] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:44 2021] GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc => generated 1275 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:45.228306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-bf358281-afbc-4bd1-8c65-9be8d24b9967 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '.version_select at 0x7f98b02c8a60>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:45.479306 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-bf358281-afbc-4bd1-8c65-9be8d24b9967 tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/42a135cc-1e4e-4724-8c79-cda705e48efc" status: 202 len: 0 microversion: 2.1 time: 0.254886 Feb 17 03:41:45.479954 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 728/1464] 10.222.0.57 () {58 vars in 1262 bytes} [Wed Feb 17 03:41:45 2021] DELETE /compute/v2.1/os-security-groups/42a135cc-1e4e-4724-8c79-cda705e48efc => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:41:45.488688 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-df896776-764a-4bbc-ab82-2c9158fa21ce tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] Calling method '.version_select at 0x7f98b02ce730>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:45.506740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-df896776-764a-4bbc-ab82-2c9158fa21ce tempest-TestVolumeBootPattern-1345402300 tempest-TestVolumeBootPattern-1345402300-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-461955903" status: 202 len: 0 microversion: 2.1 time: 0.022111 Feb 17 03:41:45.507373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 737/1465] 10.222.0.57 () {58 vars in 1250 bytes} [Wed Feb 17 03:41:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-461955903 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:41:46.147109 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ef52966e-d11f-430d-86f8-b9869b1110f2 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:46.147791 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ef52966e-d11f-430d-86f8-b9869b1110f2 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:46.156049 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef52966e-d11f-430d-86f8-b9869b1110f2 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:46.156701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef52966e-d11f-430d-86f8-b9869b1110f2 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:46.157578 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef52966e-d11f-430d-86f8-b9869b1110f2 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:46.158074 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef52966e-d11f-430d-86f8-b9869b1110f2 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:46.827938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-ef52966e-d11f-430d-86f8-b9869b1110f2 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943f64de44d9455f9cba647492b8694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1de2d733f40e280136eb9fa396503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:46.839401 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ef52966e-d11f-430d-86f8-b9869b1110f2 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] 10.222.0.57 "GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc" status: 200 len: 1315 microversion: 2.1 time: 0.696223 Feb 17 03:41:46.840144 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 729/1466] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:46 2021] GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:47.795412 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-f9878795-c450-4882-9fd8-2b9b6627bc2f req-85dd4e4b-20c2-41da-8bcb-64ce94aac22b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56b9fe60-c754-430e-8ba3-21fa13ab78cc", "tag": "ac9f74fd-7f9e-4b53-b299-449277c33a00"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:41:47.797121 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:41:47.797121 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:41:47.807986 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-f9878795-c450-4882-9fd8-2b9b6627bc2f req-85dd4e4b-20c2-41da-8bcb-64ce94aac22b service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:47.808474 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-f9878795-c450-4882-9fd8-2b9b6627bc2f req-85dd4e4b-20c2-41da-8bcb-64ce94aac22b service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:47.834161 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-f9878795-c450-4882-9fd8-2b9b6627bc2f req-85dd4e4b-20c2-41da-8bcb-64ce94aac22b service nova] Creating event network-changed:ac9f74fd-7f9e-4b53-b299-449277c33a00 for instance 56b9fe60-c754-430e-8ba3-21fa13ab78cc on hv-cinder-75994 Feb 17 03:41:47.841804 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-f9878795-c450-4882-9fd8-2b9b6627bc2f req-85dd4e4b-20c2-41da-8bcb-64ce94aac22b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050448 Feb 17 03:41:47.842509 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 738/1467] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:41:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:41:47.876587 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-269041b3-d626-4a02-886e-549fc7a2c0f4 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:47.877643 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-269041b3-d626-4a02-886e-549fc7a2c0f4 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:47.900373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-269041b3-d626-4a02-886e-549fc7a2c0f4 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:47.901473 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-269041b3-d626-4a02-886e-549fc7a2c0f4 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:47.902540 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-269041b3-d626-4a02-886e-549fc7a2c0f4 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:47.907350 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-269041b3-d626-4a02-886e-549fc7a2c0f4 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:48.298039 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-269041b3-d626-4a02-886e-549fc7a2c0f4 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943f64de44d9455f9cba647492b8694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1de2d733f40e280136eb9fa396503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:48.308020 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-269041b3-d626-4a02-886e-549fc7a2c0f4 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] 10.222.0.57 "GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc" status: 200 len: 1315 microversion: 2.1 time: 0.453574 Feb 17 03:41:48.308757 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 730/1468] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:47 2021] GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:49.328006 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-931d9173-e0f9-401f-a710-c866abbc948f tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:49.329433 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-931d9173-e0f9-401f-a710-c866abbc948f tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:49.340751 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-931d9173-e0f9-401f-a710-c866abbc948f tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:49.341296 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-931d9173-e0f9-401f-a710-c866abbc948f tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:49.342179 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-931d9173-e0f9-401f-a710-c866abbc948f tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:49.342672 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-931d9173-e0f9-401f-a710-c866abbc948f tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:49.805919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-931d9173-e0f9-401f-a710-c866abbc948f tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943f64de44d9455f9cba647492b8694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1de2d733f40e280136eb9fa396503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:49.814883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-931d9173-e0f9-401f-a710-c866abbc948f tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] 10.222.0.57 "GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc" status: 200 len: 1315 microversion: 2.1 time: 0.491581 Feb 17 03:41:49.815470 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 739/1469] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:49 2021] GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:50.834627 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fa18515c-7b35-4f2d-a2cf-aaedc545476d tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:50.835343 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fa18515c-7b35-4f2d-a2cf-aaedc545476d tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:50.843535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fa18515c-7b35-4f2d-a2cf-aaedc545476d tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:50.844006 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fa18515c-7b35-4f2d-a2cf-aaedc545476d tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:50.844850 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fa18515c-7b35-4f2d-a2cf-aaedc545476d tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:50.845381 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fa18515c-7b35-4f2d-a2cf-aaedc545476d tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:51.067433 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-fa18515c-7b35-4f2d-a2cf-aaedc545476d tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943f64de44d9455f9cba647492b8694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1de2d733f40e280136eb9fa396503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:51.083598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fa18515c-7b35-4f2d-a2cf-aaedc545476d tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] 10.222.0.57 "GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc" status: 200 len: 1315 microversion: 2.1 time: 0.253549 Feb 17 03:41:51.084352 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 731/1470] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:50 2021] GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:52.102166 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1f7bc5e3-f42d-4d7b-972a-6cdd815c35ef tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:52.103369 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1f7bc5e3-f42d-4d7b-972a-6cdd815c35ef tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:52.111823 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1f7bc5e3-f42d-4d7b-972a-6cdd815c35ef tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:52.112334 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1f7bc5e3-f42d-4d7b-972a-6cdd815c35ef tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:52.113275 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1f7bc5e3-f42d-4d7b-972a-6cdd815c35ef tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:52.113823 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1f7bc5e3-f42d-4d7b-972a-6cdd815c35ef tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:52.971919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1f7bc5e3-f42d-4d7b-972a-6cdd815c35ef tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943f64de44d9455f9cba647492b8694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1de2d733f40e280136eb9fa396503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:52.981549 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1f7bc5e3-f42d-4d7b-972a-6cdd815c35ef tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] 10.222.0.57 "GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc" status: 200 len: 1315 microversion: 2.1 time: 0.883344 Feb 17 03:41:52.982162 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 740/1471] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:52 2021] GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc => generated 1315 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:54.000504 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-963a6dd5-bb57-4591-9c28-ba5a41507d03 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:54.001208 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-963a6dd5-bb57-4591-9c28-ba5a41507d03 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:54.009889 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-963a6dd5-bb57-4591-9c28-ba5a41507d03 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:54.010402 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-963a6dd5-bb57-4591-9c28-ba5a41507d03 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:54.011297 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-963a6dd5-bb57-4591-9c28-ba5a41507d03 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:54.011913 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-963a6dd5-bb57-4591-9c28-ba5a41507d03 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:54.228190 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-963a6dd5-bb57-4591-9c28-ba5a41507d03 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943f64de44d9455f9cba647492b8694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1de2d733f40e280136eb9fa396503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:54.237085 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-963a6dd5-bb57-4591-9c28-ba5a41507d03 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] 10.222.0.57 "GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc" status: 200 len: 1315 microversion: 2.1 time: 0.240873 Feb 17 03:41:54.237686 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 732/1472] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:53 2021] GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:55.256461 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-fb8f9e43-fd30-4646-a053-3e3d4f53d007 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:55.257821 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-fb8f9e43-fd30-4646-a053-3e3d4f53d007 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:55.266098 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fb8f9e43-fd30-4646-a053-3e3d4f53d007 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:55.266613 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fb8f9e43-fd30-4646-a053-3e3d4f53d007 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:55.267464 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fb8f9e43-fd30-4646-a053-3e3d4f53d007 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:55.267957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-fb8f9e43-fd30-4646-a053-3e3d4f53d007 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:55.286023 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-ccc70d3c-ebc9-4dca-837e-9c3f9011395b req-558e8a25-9316-4ea4-8720-1245602fc6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56b9fe60-c754-430e-8ba3-21fa13ab78cc", "name": "network-vif-plugged", "status": "completed", "tag": "ac9f74fd-7f9e-4b53-b299-449277c33a00"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:41:55.288040 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:41:55.288040 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:41:55.299974 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-ccc70d3c-ebc9-4dca-837e-9c3f9011395b req-558e8a25-9316-4ea4-8720-1245602fc6e0 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:55.300576 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-ccc70d3c-ebc9-4dca-837e-9c3f9011395b req-558e8a25-9316-4ea4-8720-1245602fc6e0 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:55.322504 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-ccc70d3c-ebc9-4dca-837e-9c3f9011395b req-558e8a25-9316-4ea4-8720-1245602fc6e0 service nova] Creating event network-vif-plugged:ac9f74fd-7f9e-4b53-b299-449277c33a00 for instance 56b9fe60-c754-430e-8ba3-21fa13ab78cc on hv-cinder-75994 Feb 17 03:41:55.328982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-ccc70d3c-ebc9-4dca-837e-9c3f9011395b req-558e8a25-9316-4ea4-8720-1245602fc6e0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047677 Feb 17 03:41:55.330269 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 733/1473] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:41:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:41:55.801528 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-fb8f9e43-fd30-4646-a053-3e3d4f53d007 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943f64de44d9455f9cba647492b8694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1de2d733f40e280136eb9fa396503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:55.812328 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-fb8f9e43-fd30-4646-a053-3e3d4f53d007 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] 10.222.0.57 "GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc" status: 200 len: 1315 microversion: 2.1 time: 0.560296 Feb 17 03:41:55.812947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 741/1474] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:55 2021] GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:56.838180 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-79765a77-33f5-45a3-ae0f-61fa46ba1d47 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:56.840379 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-79765a77-33f5-45a3-ae0f-61fa46ba1d47 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:56.855177 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-79765a77-33f5-45a3-ae0f-61fa46ba1d47 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:56.856037 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-79765a77-33f5-45a3-ae0f-61fa46ba1d47 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:56.857911 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-79765a77-33f5-45a3-ae0f-61fa46ba1d47 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:56.860207 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-79765a77-33f5-45a3-ae0f-61fa46ba1d47 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:57.126600 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-79765a77-33f5-45a3-ae0f-61fa46ba1d47 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943f64de44d9455f9cba647492b8694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1de2d733f40e280136eb9fa396503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:57.137326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-79765a77-33f5-45a3-ae0f-61fa46ba1d47 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] 10.222.0.57 "GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc" status: 200 len: 1315 microversion: 2.1 time: 0.308357 Feb 17 03:41:57.138243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 734/1475] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:56 2021] GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:58.155484 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-488a0e4d-f6ee-486e-9305-2098848e3531 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:58.156179 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-488a0e4d-f6ee-486e-9305-2098848e3531 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:58.164186 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-488a0e4d-f6ee-486e-9305-2098848e3531 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:58.164790 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-488a0e4d-f6ee-486e-9305-2098848e3531 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:58.165745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-488a0e4d-f6ee-486e-9305-2098848e3531 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:58.166311 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-488a0e4d-f6ee-486e-9305-2098848e3531 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:58.886434 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-488a0e4d-f6ee-486e-9305-2098848e3531 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943f64de44d9455f9cba647492b8694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1de2d733f40e280136eb9fa396503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:58.897717 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-488a0e4d-f6ee-486e-9305-2098848e3531 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] 10.222.0.57 "GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc" status: 200 len: 1465 microversion: 2.1 time: 0.745702 Feb 17 03:41:58.898563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 742/1476] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:58 2021] GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc => generated 1465 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:41:58.975661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-ef0c6852-bef8-4376-8134-2bd60a4c34fa tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:58.976410 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ef0c6852-bef8-4376-8134-2bd60a4c34fa tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:58.985158 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef0c6852-bef8-4376-8134-2bd60a4c34fa tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:58.985755 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef0c6852-bef8-4376-8134-2bd60a4c34fa tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:58.986783 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef0c6852-bef8-4376-8134-2bd60a4c34fa tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:58.987429 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-ef0c6852-bef8-4376-8134-2bd60a4c34fa tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:59.058406 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-ef0c6852-bef8-4376-8134-2bd60a4c34fa tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] Going to try to terminate instance {{(pid=98103) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:41:59.183302 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-ef0c6852-bef8-4376-8134-2bd60a4c34fa tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] 10.222.0.57 "DELETE /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc" status: 204 len: 0 microversion: 2.1 time: 0.212123 Feb 17 03:41:59.184250 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 735/1477] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:41:58 2021] DELETE /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:41:59.193774 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d4572b71-2bd6-439d-b8a4-dd3e4e9c41bd tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:41:59.194582 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d4572b71-2bd6-439d-b8a4-dd3e4e9c41bd tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:41:59.203427 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d4572b71-2bd6-439d-b8a4-dd3e4e9c41bd tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:59.204293 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d4572b71-2bd6-439d-b8a4-dd3e4e9c41bd tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:59.205247 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d4572b71-2bd6-439d-b8a4-dd3e4e9c41bd tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:41:59.205826 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d4572b71-2bd6-439d-b8a4-dd3e4e9c41bd tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:41:59.424961 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d4572b71-2bd6-439d-b8a4-dd3e4e9c41bd tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943f64de44d9455f9cba647492b8694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1de2d733f40e280136eb9fa396503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:41:59.433730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d4572b71-2bd6-439d-b8a4-dd3e4e9c41bd tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] 10.222.0.57 "GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc" status: 200 len: 1471 microversion: 2.1 time: 0.245043 Feb 17 03:41:59.434319 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 743/1478] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:41:59 2021] GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:42:00.453833 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d13daccf-546f-476b-9067-cc33a11f9af5 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:42:00.454656 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d13daccf-546f-476b-9067-cc33a11f9af5 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:42:00.463134 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d13daccf-546f-476b-9067-cc33a11f9af5 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:00.463650 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d13daccf-546f-476b-9067-cc33a11f9af5 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:00.464490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d13daccf-546f-476b-9067-cc33a11f9af5 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:00.464987 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d13daccf-546f-476b-9067-cc33a11f9af5 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:00.683282 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d13daccf-546f-476b-9067-cc33a11f9af5 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943f64de44d9455f9cba647492b8694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1de2d733f40e280136eb9fa396503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:42:00.692845 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d13daccf-546f-476b-9067-cc33a11f9af5 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] 10.222.0.57 "GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc" status: 200 len: 1471 microversion: 2.1 time: 0.243928 Feb 17 03:42:00.693462 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 736/1479] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:42:00 2021] GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc => generated 1471 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:42:01.712443 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b1227b19-4700-4655-ac36-57b6aeb3f4a8 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:42:01.713253 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b1227b19-4700-4655-ac36-57b6aeb3f4a8 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:42:01.721447 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b1227b19-4700-4655-ac36-57b6aeb3f4a8 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:01.722784 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b1227b19-4700-4655-ac36-57b6aeb3f4a8 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:01.723168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b1227b19-4700-4655-ac36-57b6aeb3f4a8 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:01.723766 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b1227b19-4700-4655-ac36-57b6aeb3f4a8 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:02.126159 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-8db0bee9-84e2-4cdf-8612-7e95b1e5989b req-3e6a1f0b-248b-4da4-94a5-261fa304b0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56b9fe60-c754-430e-8ba3-21fa13ab78cc", "name": "network-vif-unplugged", "status": "completed", "tag": "ac9f74fd-7f9e-4b53-b299-449277c33a00"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:42:02.128277 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:42:02.128277 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:42:02.137579 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8ff24237-f33c-4d73-814b-e5e3dc9cdef7] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 17 03:42:02.139768 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-8db0bee9-84e2-4cdf-8612-7e95b1e5989b req-3e6a1f0b-248b-4da4-94a5-261fa304b0d0 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:02.140488 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-8db0bee9-84e2-4cdf-8612-7e95b1e5989b req-3e6a1f0b-248b-4da4-94a5-261fa304b0d0 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:02.173734 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-8db0bee9-84e2-4cdf-8612-7e95b1e5989b req-3e6a1f0b-248b-4da4-94a5-261fa304b0d0 service nova] Creating event network-vif-unplugged:ac9f74fd-7f9e-4b53-b299-449277c33a00 for instance 56b9fe60-c754-430e-8ba3-21fa13ab78cc on hv-cinder-75994 Feb 17 03:42:02.180277 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-8db0bee9-84e2-4cdf-8612-7e95b1e5989b req-3e6a1f0b-248b-4da4-94a5-261fa304b0d0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057822 Feb 17 03:42:02.182325 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 737/1480] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:42:02 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:42:02.192183 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b1227b19-4700-4655-ac36-57b6aeb3f4a8 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943f64de44d9455f9cba647492b8694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1de2d733f40e280136eb9fa396503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:42:02.202398 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b1227b19-4700-4655-ac36-57b6aeb3f4a8 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] 10.222.0.57 "GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc" status: 200 len: 1471 microversion: 2.1 time: 0.494212 Feb 17 03:42:02.211009 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 744/1481] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:42:01 2021] GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc => generated 1471 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:42:03.222263 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-2930f4f0-c86b-4da0-8efe-590c26dec098 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:42:03.223045 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-2930f4f0-c86b-4da0-8efe-590c26dec098 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:42:03.242063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2930f4f0-c86b-4da0-8efe-590c26dec098 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:03.242579 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2930f4f0-c86b-4da0-8efe-590c26dec098 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:03.243442 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2930f4f0-c86b-4da0-8efe-590c26dec098 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:03.243941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-2930f4f0-c86b-4da0-8efe-590c26dec098 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:03.303919 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] [8ff24237-f33c-4d73-814b-e5e3dc9cdef7] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 59086. Feb 17 03:42:03.465803 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-2930f4f0-c86b-4da0-8efe-590c26dec098 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '943f64de44d9455f9cba647492b8694c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1de2d733f40e280136eb9fa396503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:42:03.474852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-2930f4f0-c86b-4da0-8efe-590c26dec098 tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] 10.222.0.57 "GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc" status: 200 len: 1471 microversion: 2.1 time: 0.257059 Feb 17 03:42:03.475674 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 738/1482] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:42:03 2021] GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc => generated 1471 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:42:03.786835 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-0bde964e-5519-47af-aee2-1dc8efcc2198 req-e71d85a7-a92b-4c09-b708-3a3c270d5e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56b9fe60-c754-430e-8ba3-21fa13ab78cc", "name": "network-vif-deleted", "tag": "ac9f74fd-7f9e-4b53-b299-449277c33a00"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:42:03.788917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:42:03.788917 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:42:03.798729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-0bde964e-5519-47af-aee2-1dc8efcc2198 req-e71d85a7-a92b-4c09-b708-3a3c270d5e88 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:03.799275 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-0bde964e-5519-47af-aee2-1dc8efcc2198 req-e71d85a7-a92b-4c09-b708-3a3c270d5e88 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:03.820556 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-0bde964e-5519-47af-aee2-1dc8efcc2198 req-e71d85a7-a92b-4c09-b708-3a3c270d5e88 service nova] Creating event network-vif-deleted:ac9f74fd-7f9e-4b53-b299-449277c33a00 for instance 56b9fe60-c754-430e-8ba3-21fa13ab78cc on hv-cinder-75994 Feb 17 03:42:03.826600 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-0bde964e-5519-47af-aee2-1dc8efcc2198 req-e71d85a7-a92b-4c09-b708-3a3c270d5e88 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044014 Feb 17 03:42:03.827253 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 745/1483] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:42:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:42:04.492797 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f65bcf86-ce36-4543-a5b2-82c3fdc2b1ac tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:42:04.493383 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f65bcf86-ce36-4543-a5b2-82c3fdc2b1ac tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] [instance: 56b9fe60-c754-430e-8ba3-21fa13ab78cc] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:42:04.501223 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f65bcf86-ce36-4543-a5b2-82c3fdc2b1ac tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:04.501733 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f65bcf86-ce36-4543-a5b2-82c3fdc2b1ac tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:04.502583 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f65bcf86-ce36-4543-a5b2-82c3fdc2b1ac tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:04.503072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f65bcf86-ce36-4543-a5b2-82c3fdc2b1ac tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:04.557242 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-f65bcf86-ce36-4543-a5b2-82c3fdc2b1ac tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] HTTP exception thrown: Instance 56b9fe60-c754-430e-8ba3-21fa13ab78cc could not be found. Feb 17 03:42:04.557926 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f65bcf86-ce36-4543-a5b2-82c3fdc2b1ac tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] Returning 404 to user: Instance 56b9fe60-c754-430e-8ba3-21fa13ab78cc could not be found. {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:42:04.558842 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f65bcf86-ce36-4543-a5b2-82c3fdc2b1ac tempest-VolumesNegativeTest-429381555 tempest-VolumesNegativeTest-429381555-project] 10.222.0.57 "GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc" status: 404 len: 111 microversion: 2.1 time: 0.070254 Feb 17 03:42:04.559458 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 739/1484] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:42:04 2021] GET /compute/v2.1/servers/56b9fe60-c754-430e-8ba3-21fa13ab78cc => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:42:26.238757 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8fe8f36b-3b81-45bd-a263-cbfb21b217d8] AMQP server on 10.222.0.57:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Feb 17 03:42:26.462950 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8fc62287-834a-478e-ad7b-dfe1f81b3c32 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Action: 'create', calling method: .version_select at 0x7f98b0607c80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1251723052"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:42:26.489908 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-8fc62287-834a-478e-ad7b-dfe1f81b3c32 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Getting quotas for project 6d1987144d0f48bfb9d06f558ccc8618. Resources: {'key_pairs'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:42:26.494162 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-8fc62287-834a-478e-ad7b-dfe1f81b3c32 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Getting quotas for user c89a719e1785453bb422dcfe11f5817d and project 6d1987144d0f48bfb9d06f558ccc8618. Resources: {'key_pairs'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:42:26.642609 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-8fc62287-834a-478e-ad7b-dfe1f81b3c32 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Getting quotas for project 6d1987144d0f48bfb9d06f558ccc8618. Resources: {'key_pairs'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:42:26.646716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-8fc62287-834a-478e-ad7b-dfe1f81b3c32 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Getting quotas for user c89a719e1785453bb422dcfe11f5817d and project 6d1987144d0f48bfb9d06f558ccc8618. Resources: {'key_pairs'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:42:26.660467 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8fc62287-834a-478e-ad7b-dfe1f81b3c32 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.423291 Feb 17 03:42:26.661459 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 746/1485] 10.222.0.57 () {60 vars in 1148 bytes} [Wed Feb 17 03:42:26 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:42:26.672531 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b95a4b50-8698-4719-80a5-4571415ef382 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Action: 'create', calling method: .version_select at 0x7f98b0300e18>, body: {"security_group": {"name": "tempest-TestShelveInstance-1803925205", "description": "tempest-TestShelveInstance-1803925205 description"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:42:26.886608 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b95a4b50-8698-4719-80a5-4571415ef382 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.218221 Feb 17 03:42:26.887434 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 740/1486] 10.222.0.57 () {60 vars in 1170 bytes} [Wed Feb 17 03:42:26 2021] POST /compute/v2.1/os-security-groups => generated 245 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 17 03:42:26.899127 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-798ddbfe-fb85-4305-acd8-4a4e5a3a6e68 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Action: 'create', calling method: .version_select at 0x7f98b00c9d90>, body: {"security_group_rule": {"parent_group_id": "c91227bb-43a5-40ff-bd7d-20adc312d046", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:42:27.123928 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-798ddbfe-fb85-4305-acd8-4a4e5a3a6e68 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.228908 Feb 17 03:42:27.124587 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 747/1487] 10.222.0.57 () {60 vars in 1185 bytes} [Wed Feb 17 03:42:26 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:42:27.135586 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a37da915-8222-40d0-aa46-9934b43f0029 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Action: 'create', calling method: .version_select at 0x7f98b0300ae8>, body: {"security_group_rule": {"parent_group_id": "c91227bb-43a5-40ff-bd7d-20adc312d046", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:42:27.363973 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a37da915-8222-40d0-aa46-9934b43f0029 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.232215 Feb 17 03:42:27.364787 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 741/1488] 10.222.0.57 () {60 vars in 1185 bytes} [Wed Feb 17 03:42:27 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:42:50.052254 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7cd1d972-1fa3-4933-8599-2f7dcf269b7d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1185039964", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1251723052", "security_groups": [{"name": "tempest-TestShelveInstance-1803925205"}], "networks": [{"uuid": "6d75f49d-2a5f-4240-85a8-12f51dafc5ee"}], "block_device_mapping_v2": [{"uuid": "97bc8988-922f-41d2-bfae-03bf82c25f38", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:42:50.086151 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] [8fe8f36b-3b81-45bd-a263-cbfb21b217d8] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 59526. Feb 17 03:42:50.335028 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-7cd1d972-1fa3-4933-8599-2f7dcf269b7d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] validate_networks() for [('6d75f49d-2a5f-4240-85a8-12f51dafc5ee', None, None, None)] {{(pid=98104) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 17 03:42:50.899428 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-7cd1d972-1fa3-4933-8599-2f7dcf269b7d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Flavor limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 17 03:42:50.899944 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-7cd1d972-1fa3-4933-8599-2f7dcf269b7d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Image limits 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 17 03:42:50.900493 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-7cd1d972-1fa3-4933-8599-2f7dcf269b7d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Flavor pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 17 03:42:50.900982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-7cd1d972-1fa3-4933-8599-2f7dcf269b7d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Image pref 0:0:0 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 17 03:42:50.901499 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.virt.hardware [None req-7cd1d972-1fa3-4933-8599-2f7dcf269b7d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 17 03:42:50.910929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7cd1d972-1fa3-4933-8599-2f7dcf269b7d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:50.911428 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7cd1d972-1fa3-4933-8599-2f7dcf269b7d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:50.912305 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7cd1d972-1fa3-4933-8599-2f7dcf269b7d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:50.912798 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7cd1d972-1fa3-4933-8599-2f7dcf269b7d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:50.931671 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-7cd1d972-1fa3-4933-8599-2f7dcf269b7d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Getting quotas for project 6d1987144d0f48bfb9d06f558ccc8618. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 17 03:42:50.935970 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.quota [None req-7cd1d972-1fa3-4933-8599-2f7dcf269b7d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Getting quotas for user c89a719e1785453bb422dcfe11f5817d and project 6d1987144d0f48bfb9d06f558ccc8618. Resources: {'ram', 'cores', 'instances'} {{(pid=98104) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 17 03:42:51.042241 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7cd1d972-1fa3-4933-8599-2f7dcf269b7d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Going to run 1 instances... {{(pid=98104) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 17 03:42:51.044730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7cd1d972-1fa3-4933-8599-2f7dcf269b7d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97bc8988-922f-41d2-bfae-03bf82c25f38',volume_size=None,volume_type=None)] {{(pid=98104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 17 03:42:51.219489 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7cd1d972-1fa3-4933-8599-2f7dcf269b7d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 1.182176 Feb 17 03:42:51.220193 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 748/1489] 10.222.0.57 () {60 vars in 1137 bytes} [Wed Feb 17 03:42:50 2021] POST /compute/v2.1/servers => generated 410 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 17 03:42:51.231463 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-73c370ed-a730-49f9-a304-003f63d05599 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:42:51.232133 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-73c370ed-a730-49f9-a304-003f63d05599 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:42:51.439932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-73c370ed-a730-49f9-a304-003f63d05599 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:42:51.448633 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-73c370ed-a730-49f9-a304-003f63d05599 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1089 microversion: 2.1 time: 0.221139 Feb 17 03:42:51.449536 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 742/1490] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:42:51 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1089 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:42:52.467569 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8e82c4ab-7424-4d53-b1bc-86e814bb990f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:42:52.468239 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8e82c4ab-7424-4d53-b1bc-86e814bb990f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:42:52.477136 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8e82c4ab-7424-4d53-b1bc-86e814bb990f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:52.477644 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8e82c4ab-7424-4d53-b1bc-86e814bb990f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:52.478674 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8e82c4ab-7424-4d53-b1bc-86e814bb990f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:52.479172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8e82c4ab-7424-4d53-b1bc-86e814bb990f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:52.622683 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8e82c4ab-7424-4d53-b1bc-86e814bb990f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:42:52.632205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8e82c4ab-7424-4d53-b1bc-86e814bb990f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1205 microversion: 2.1 time: 0.168601 Feb 17 03:42:52.632785 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 749/1491] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:42:52 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1205 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:42:53.651250 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-44cde262-243d-430c-804f-8c6e14a30c74 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:42:53.651932 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-44cde262-243d-430c-804f-8c6e14a30c74 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:42:53.660149 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-44cde262-243d-430c-804f-8c6e14a30c74 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:53.660670 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-44cde262-243d-430c-804f-8c6e14a30c74 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:53.662178 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-44cde262-243d-430c-804f-8c6e14a30c74 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:53.662674 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-44cde262-243d-430c-804f-8c6e14a30c74 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:54.174393 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-44cde262-243d-430c-804f-8c6e14a30c74 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:42:54.183704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-44cde262-243d-430c-804f-8c6e14a30c74 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1265 microversion: 2.1 time: 0.536469 Feb 17 03:42:54.184313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 743/1492] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:42:53 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1265 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:42:55.179142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-3f4095e3-56bf-439b-b128-9b4f47f1cb6a req-10eadc7c-2e05-4908-88bc-8260dc4cd5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f0161e-1beb-4d64-8821-74972840276b", "tag": "39703cbb-7232-4287-b978-10f8d1e89e27"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:42:55.181200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:42:55.181200 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:42:55.190515 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-3f4095e3-56bf-439b-b128-9b4f47f1cb6a req-10eadc7c-2e05-4908-88bc-8260dc4cd5c6 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:55.191013 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-3f4095e3-56bf-439b-b128-9b4f47f1cb6a req-10eadc7c-2e05-4908-88bc-8260dc4cd5c6 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:55.202729 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-4c4d4e8f-f284-4dbc-9048-19f47fbe9712 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:42:55.203594 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-4c4d4e8f-f284-4dbc-9048-19f47fbe9712 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:42:55.210557 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-3f4095e3-56bf-439b-b128-9b4f47f1cb6a req-10eadc7c-2e05-4908-88bc-8260dc4cd5c6 service nova] Creating event network-changed:39703cbb-7232-4287-b978-10f8d1e89e27 for instance 77f0161e-1beb-4d64-8821-74972840276b on hv-cinder-75994 Feb 17 03:42:55.214414 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c4d4e8f-f284-4dbc-9048-19f47fbe9712 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:55.215061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c4d4e8f-f284-4dbc-9048-19f47fbe9712 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:55.215542 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-3f4095e3-56bf-439b-b128-9b4f47f1cb6a req-10eadc7c-2e05-4908-88bc-8260dc4cd5c6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040475 Feb 17 03:42:55.216128 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c4d4e8f-f284-4dbc-9048-19f47fbe9712 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:55.216250 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 750/1493] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:42:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:42:55.216718 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-4c4d4e8f-f284-4dbc-9048-19f47fbe9712 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:55.440415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-4c4d4e8f-f284-4dbc-9048-19f47fbe9712 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:42:55.451778 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-4c4d4e8f-f284-4dbc-9048-19f47fbe9712 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1265 microversion: 2.1 time: 0.253035 Feb 17 03:42:55.452403 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 744/1494] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:42:55 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:42:56.470626 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f9c79807-6f4c-4952-9e15-4953307c7772 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:42:56.471397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f9c79807-6f4c-4952-9e15-4953307c7772 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:42:56.480302 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f9c79807-6f4c-4952-9e15-4953307c7772 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:56.480812 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f9c79807-6f4c-4952-9e15-4953307c7772 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:56.481688 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f9c79807-6f4c-4952-9e15-4953307c7772 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:56.482186 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f9c79807-6f4c-4952-9e15-4953307c7772 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:57.074623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f9c79807-6f4c-4952-9e15-4953307c7772 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:42:57.084379 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f9c79807-6f4c-4952-9e15-4953307c7772 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1265 microversion: 2.1 time: 0.618277 Feb 17 03:42:57.084965 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 751/1495] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:42:56 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1265 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:42:58.104811 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-151f806c-feba-4c62-ab55-ccc50daf48c1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:42:58.105617 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-151f806c-feba-4c62-ab55-ccc50daf48c1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:42:58.113548 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-151f806c-feba-4c62-ab55-ccc50daf48c1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:58.114056 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-151f806c-feba-4c62-ab55-ccc50daf48c1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:58.115403 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-151f806c-feba-4c62-ab55-ccc50daf48c1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:58.115890 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-151f806c-feba-4c62-ab55-ccc50daf48c1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:58.343409 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-151f806c-feba-4c62-ab55-ccc50daf48c1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:42:58.352387 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-151f806c-feba-4c62-ab55-ccc50daf48c1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1265 microversion: 2.1 time: 0.253825 Feb 17 03:42:58.352988 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 745/1496] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:42:58 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:42:59.370789 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1b0495f0-2bd3-413c-ac11-9eb5487398b5 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:42:59.371376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1b0495f0-2bd3-413c-ac11-9eb5487398b5 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:42:59.379310 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1b0495f0-2bd3-413c-ac11-9eb5487398b5 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:59.379807 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1b0495f0-2bd3-413c-ac11-9eb5487398b5 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:59.381173 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1b0495f0-2bd3-413c-ac11-9eb5487398b5 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:42:59.381659 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1b0495f0-2bd3-413c-ac11-9eb5487398b5 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:42:59.590394 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1b0495f0-2bd3-413c-ac11-9eb5487398b5 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:42:59.599815 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1b0495f0-2bd3-413c-ac11-9eb5487398b5 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1265 microversion: 2.1 time: 0.232737 Feb 17 03:42:59.600398 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 752/1497] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:42:59 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:43:00.618307 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5014593c-267b-4844-a1af-f144e3cca248 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:43:00.618982 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5014593c-267b-4844-a1af-f144e3cca248 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:43:00.626857 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5014593c-267b-4844-a1af-f144e3cca248 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:00.627372 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5014593c-267b-4844-a1af-f144e3cca248 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:00.628214 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5014593c-267b-4844-a1af-f144e3cca248 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:00.628708 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5014593c-267b-4844-a1af-f144e3cca248 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:00.840598 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5014593c-267b-4844-a1af-f144e3cca248 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:43:00.850153 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5014593c-267b-4844-a1af-f144e3cca248 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1265 microversion: 2.1 time: 0.236438 Feb 17 03:43:00.850985 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 746/1498] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:43:00 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:43:01.868168 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0ce13184-f787-4092-bbf5-f2dbd5626bc1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:43:01.868874 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0ce13184-f787-4092-bbf5-f2dbd5626bc1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:43:01.876716 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0ce13184-f787-4092-bbf5-f2dbd5626bc1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:01.877255 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0ce13184-f787-4092-bbf5-f2dbd5626bc1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:01.878085 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0ce13184-f787-4092-bbf5-f2dbd5626bc1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:01.878572 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0ce13184-f787-4092-bbf5-f2dbd5626bc1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:02.092215 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0ce13184-f787-4092-bbf5-f2dbd5626bc1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:43:02.101790 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0ce13184-f787-4092-bbf5-f2dbd5626bc1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1265 microversion: 2.1 time: 0.237655 Feb 17 03:43:02.102387 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 753/1499] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:43:01 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:43:03.120118 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9bb6dece-a569-459f-94c3-45962d1f8971 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:43:03.120785 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9bb6dece-a569-459f-94c3-45962d1f8971 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:43:03.128595 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9bb6dece-a569-459f-94c3-45962d1f8971 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:03.129142 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9bb6dece-a569-459f-94c3-45962d1f8971 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:03.129966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9bb6dece-a569-459f-94c3-45962d1f8971 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:03.130445 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9bb6dece-a569-459f-94c3-45962d1f8971 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:03.340211 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9bb6dece-a569-459f-94c3-45962d1f8971 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:43:03.348949 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9bb6dece-a569-459f-94c3-45962d1f8971 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1265 microversion: 2.1 time: 0.233376 Feb 17 03:43:03.349593 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 747/1500] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:43:03 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:43:04.366600 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-dff2b1d3-5e99-4d87-9d4a-da61592e571d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:43:04.367193 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-dff2b1d3-5e99-4d87-9d4a-da61592e571d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:43:04.375975 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dff2b1d3-5e99-4d87-9d4a-da61592e571d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:04.376479 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dff2b1d3-5e99-4d87-9d4a-da61592e571d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:04.377361 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dff2b1d3-5e99-4d87-9d4a-da61592e571d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:04.377852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-dff2b1d3-5e99-4d87-9d4a-da61592e571d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:04.595295 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-dff2b1d3-5e99-4d87-9d4a-da61592e571d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:43:04.604045 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-dff2b1d3-5e99-4d87-9d4a-da61592e571d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1265 microversion: 2.1 time: 0.241651 Feb 17 03:43:04.604631 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 754/1501] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:43:04 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:43:05.358700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-fa2be7ea-1745-47a1-9dec-d2c4cf13695b req-e119b92e-d50b-47a9-8ce1-182040a313bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f0161e-1beb-4d64-8821-74972840276b", "name": "network-vif-plugged", "status": "completed", "tag": "39703cbb-7232-4287-b978-10f8d1e89e27"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:43:05.360885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:43:05.360885 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:43:05.370826 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-fa2be7ea-1745-47a1-9dec-d2c4cf13695b req-e119b92e-d50b-47a9-8ce1-182040a313bb service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:05.371344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-fa2be7ea-1745-47a1-9dec-d2c4cf13695b req-e119b92e-d50b-47a9-8ce1-182040a313bb service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:05.388548 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-fa2be7ea-1745-47a1-9dec-d2c4cf13695b req-e119b92e-d50b-47a9-8ce1-182040a313bb service nova] Creating event network-vif-plugged:39703cbb-7232-4287-b978-10f8d1e89e27 for instance 77f0161e-1beb-4d64-8821-74972840276b on hv-cinder-75994 Feb 17 03:43:05.393757 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-fa2be7ea-1745-47a1-9dec-d2c4cf13695b req-e119b92e-d50b-47a9-8ce1-182040a313bb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039069 Feb 17 03:43:05.394397 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 748/1502] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:43:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:43:05.621987 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8f1996c0-1930-4c5d-9a6a-4b66d3187589 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:43:05.622657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8f1996c0-1930-4c5d-9a6a-4b66d3187589 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:43:05.630565 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f1996c0-1930-4c5d-9a6a-4b66d3187589 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:05.631079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f1996c0-1930-4c5d-9a6a-4b66d3187589 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:05.631957 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f1996c0-1930-4c5d-9a6a-4b66d3187589 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:05.632573 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8f1996c0-1930-4c5d-9a6a-4b66d3187589 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:05.919786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-8f1996c0-1930-4c5d-9a6a-4b66d3187589 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:43:05.929063 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8f1996c0-1930-4c5d-9a6a-4b66d3187589 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1265 microversion: 2.1 time: 0.311137 Feb 17 03:43:05.929653 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 755/1503] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:43:05 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:43:06.947594 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9ea227e8-4165-4977-b68c-b4dc194ec4f6 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:43:06.948368 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9ea227e8-4165-4977-b68c-b4dc194ec4f6 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:43:06.956895 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9ea227e8-4165-4977-b68c-b4dc194ec4f6 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:06.957446 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9ea227e8-4165-4977-b68c-b4dc194ec4f6 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:06.958291 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9ea227e8-4165-4977-b68c-b4dc194ec4f6 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:06.958783 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9ea227e8-4165-4977-b68c-b4dc194ec4f6 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:07.177687 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9ea227e8-4165-4977-b68c-b4dc194ec4f6 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:43:07.187432 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9ea227e8-4165-4977-b68c-b4dc194ec4f6 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1265 microversion: 2.1 time: 0.244995 Feb 17 03:43:07.188033 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 749/1504] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:43:06 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:43:08.206292 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-50feb9bd-2a20-41bd-b02a-77ce4814088b tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:43:08.206900 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-50feb9bd-2a20-41bd-b02a-77ce4814088b tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:43:08.215420 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-50feb9bd-2a20-41bd-b02a-77ce4814088b tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:08.215931 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-50feb9bd-2a20-41bd-b02a-77ce4814088b tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:08.216771 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-50feb9bd-2a20-41bd-b02a-77ce4814088b tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:08.217303 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-50feb9bd-2a20-41bd-b02a-77ce4814088b tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:08.426535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-50feb9bd-2a20-41bd-b02a-77ce4814088b tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:43:08.435830 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-50feb9bd-2a20-41bd-b02a-77ce4814088b tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1449 microversion: 2.1 time: 0.233730 Feb 17 03:43:08.436419 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 756/1505] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:43:08 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1449 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:43:08.454518 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-a5bbd172-438a-4d0a-9542-b280249b6662 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:43:08.455193 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-a5bbd172-438a-4d0a-9542-b280249b6662 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:43:08.463046 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5bbd172-438a-4d0a-9542-b280249b6662 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:08.463499 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5bbd172-438a-4d0a-9542-b280249b6662 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:08.464335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5bbd172-438a-4d0a-9542-b280249b6662 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:08.464825 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-a5bbd172-438a-4d0a-9542-b280249b6662 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:08.675067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-a5bbd172-438a-4d0a-9542-b280249b6662 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:43:08.684448 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-a5bbd172-438a-4d0a-9542-b280249b6662 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1449 microversion: 2.1 time: 0.233900 Feb 17 03:43:08.685056 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 750/1506] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:43:08 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1449 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:43:08.702273 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e8378d23-98b9-44a7-bc62-34f2c4fd9d4e tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Action: 'create', calling method: .version_select at 0x7f98b03dc840>, body: {"pool": null} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:43:10.701406 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e8378d23-98b9-44a7-bc62-34f2c4fd9d4e tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.003270 Feb 17 03:43:10.702048 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 757/1507] 10.222.0.57 () {60 vars in 1160 bytes} [Wed Feb 17 03:43:08 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2005 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:43:10.713730 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-63cd255f-a56c-4d36-aafb-6a808761c780 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.0.65"}} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:43:10.714930 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-63cd255f-a56c-4d36-aafb-6a808761c780 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:43:10.722866 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-63cd255f-a56c-4d36-aafb-6a808761c780 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:10.723370 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-63cd255f-a56c-4d36-aafb-6a808761c780 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:10.724211 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-63cd255f-a56c-4d36-aafb-6a808761c780 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:10.724702 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-63cd255f-a56c-4d36-aafb-6a808761c780 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:10.790808 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-63cd255f-a56c-4d36-aafb-6a808761c780 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Acquired lock "refresh_cache-77f0161e-1beb-4d64-8821-74972840276b" {{(pid=98103) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:43:12.493881 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-63cd255f-a56c-4d36-aafb-6a808761c780 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 03:43:12.503317 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-69bc2b01-b78f-4215-8d0a-f28ab85b27cd req-c6b0d3ca-1fea-478e-8f7d-8c2d451839e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f0161e-1beb-4d64-8821-74972840276b", "tag": "39703cbb-7232-4287-b978-10f8d1e89e27"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:43:12.505527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:43:12.505527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:43:12.516355 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-69bc2b01-b78f-4215-8d0a-f28ab85b27cd req-c6b0d3ca-1fea-478e-8f7d-8c2d451839e4 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:43:12.517303 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-69bc2b01-b78f-4215-8d0a-f28ab85b27cd req-c6b0d3ca-1fea-478e-8f7d-8c2d451839e4 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:43:12.536958 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-69bc2b01-b78f-4215-8d0a-f28ab85b27cd req-c6b0d3ca-1fea-478e-8f7d-8c2d451839e4 service nova] Creating event network-changed:39703cbb-7232-4287-b978-10f8d1e89e27 for instance 77f0161e-1beb-4d64-8821-74972840276b on hv-cinder-75994 Feb 17 03:43:12.543218 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-69bc2b01-b78f-4215-8d0a-f28ab85b27cd req-c6b0d3ca-1fea-478e-8f7d-8c2d451839e4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043815 Feb 17 03:43:12.544179 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 758/1508] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:43:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:43:13.571726 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-63cd255f-a56c-4d36-aafb-6a808761c780 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Updating instance_info_cache with network_info: [{"id": "39703cbb-7232-4287-b978-10f8d1e89e27", "address": "fa:16:3e:bd:f3:78", "network": {"id": "6d75f49d-2a5f-4240-85a8-12f51dafc5ee", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288731035-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6d1987144d0f48bfb9d06f558ccc8618", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap39703cbb-72", "ovs_interfaceid": "39703cbb-7232-4287-b978-10f8d1e89e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 03:43:13.580197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-63cd255f-a56c-4d36-aafb-6a808761c780 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Releasing lock "refresh_cache-77f0161e-1beb-4d64-8821-74972840276b" {{(pid=98103) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:43:13.581328 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-63cd255f-a56c-4d36-aafb-6a808761c780 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "POST /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b/action" status: 202 len: 0 microversion: 2.1 time: 2.871708 Feb 17 03:43:13.581990 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 751/1509] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:43:10 2021] POST /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b/action => generated 0 bytes in 2873 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 17 03:44:04.547154 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:44:04.547773 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:44:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:44:29.642776 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:44:29.643384 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:44:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:44:34.557797 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:44:34.558378 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:44:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:45:28.530823 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8fe8f36b-3b81-45bd-a263-cbfb21b217d8] AMQP server on 10.222.0.57:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Feb 17 03:45:28.535278 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9f2b096f-9db9-4ddd-8829-3b5b6b86e63e tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:45:28.535962 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9f2b096f-9db9-4ddd-8829-3b5b6b86e63e tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:28.544114 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9f2b096f-9db9-4ddd-8829-3b5b6b86e63e tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:28.544623 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9f2b096f-9db9-4ddd-8829-3b5b6b86e63e tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:28.545499 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9f2b096f-9db9-4ddd-8829-3b5b6b86e63e tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:28.545994 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9f2b096f-9db9-4ddd-8829-3b5b6b86e63e tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:28.610166 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-9f2b096f-9db9-4ddd-8829-3b5b6b86e63e tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lazy-loading 'flavor' on Instance uuid 77f0161e-1beb-4d64-8821-74972840276b {{(pid=98104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:45:28.757211 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9f2b096f-9db9-4ddd-8829-3b5b6b86e63e tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "POST /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b/action" status: 202 len: 0 microversion: 2.1 time: 0.227776 Feb 17 03:45:28.757929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 759/1510] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:45:28 2021] POST /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:45:28.763999 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8ff24237-f33c-4d73-814b-e5e3dc9cdef7] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 17 03:45:28.767584 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-87191da4-ae53-4ee3-9043-66bc644170d3 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:28.768251 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-87191da4-ae53-4ee3-9043-66bc644170d3 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:28.776336 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-87191da4-ae53-4ee3-9043-66bc644170d3 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:28.776844 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-87191da4-ae53-4ee3-9043-66bc644170d3 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:28.777737 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-87191da4-ae53-4ee3-9043-66bc644170d3 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:28.778240 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-87191da4-ae53-4ee3-9043-66bc644170d3 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:29.005933 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-87191da4-ae53-4ee3-9043-66bc644170d3 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:29.014903 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-87191da4-ae53-4ee3-9043-66bc644170d3 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1573 microversion: 2.1 time: 0.252383 Feb 17 03:45:29.015684 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 752/1511] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:28 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1573 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 17 03:45:30.045943 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-16dfc9c9-6f69-45c2-be4e-c93a5254775c tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:30.046704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-16dfc9c9-6f69-45c2-be4e-c93a5254775c tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:30.055277 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] [8fe8f36b-3b81-45bd-a263-cbfb21b217d8] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 59628. Feb 17 03:45:30.061487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-16dfc9c9-6f69-45c2-be4e-c93a5254775c tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:30.062017 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-16dfc9c9-6f69-45c2-be4e-c93a5254775c tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:30.062845 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-16dfc9c9-6f69-45c2-be4e-c93a5254775c tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:30.063326 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-16dfc9c9-6f69-45c2-be4e-c93a5254775c tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:30.276174 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-16dfc9c9-6f69-45c2-be4e-c93a5254775c tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:30.285595 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-16dfc9c9-6f69-45c2-be4e-c93a5254775c tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1573 microversion: 2.1 time: 0.255567 Feb 17 03:45:30.286189 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 760/1512] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:30 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1573 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:31.303971 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-31577a70-d477-4648-9bb7-86d8210f7b44 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:31.304559 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-31577a70-d477-4648-9bb7-86d8210f7b44 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:31.323045 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-31577a70-d477-4648-9bb7-86d8210f7b44 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:31.323555 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-31577a70-d477-4648-9bb7-86d8210f7b44 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:31.324388 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-31577a70-d477-4648-9bb7-86d8210f7b44 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:31.325178 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-31577a70-d477-4648-9bb7-86d8210f7b44 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:31.362002 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] [8ff24237-f33c-4d73-814b-e5e3dc9cdef7] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 59632. Feb 17 03:45:31.534393 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-31577a70-d477-4648-9bb7-86d8210f7b44 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:31.543279 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-31577a70-d477-4648-9bb7-86d8210f7b44 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1573 microversion: 2.1 time: 0.243365 Feb 17 03:45:31.543873 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 753/1513] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:31 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1573 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:32.561157 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-0106c440-8111-4a25-be7c-2827be324ef9 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:32.561815 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-0106c440-8111-4a25-be7c-2827be324ef9 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:32.569562 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0106c440-8111-4a25-be7c-2827be324ef9 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:32.570057 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0106c440-8111-4a25-be7c-2827be324ef9 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:32.570876 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0106c440-8111-4a25-be7c-2827be324ef9 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:32.571362 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-0106c440-8111-4a25-be7c-2827be324ef9 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:32.782535 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-0106c440-8111-4a25-be7c-2827be324ef9 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:32.791266 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-0106c440-8111-4a25-be7c-2827be324ef9 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1573 microversion: 2.1 time: 0.234128 Feb 17 03:45:32.791852 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 761/1514] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:32 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1573 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:33.809587 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6cc46180-39bf-4299-9136-d3b01a4038b1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:33.810291 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6cc46180-39bf-4299-9136-d3b01a4038b1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:33.818171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6cc46180-39bf-4299-9136-d3b01a4038b1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:33.818676 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6cc46180-39bf-4299-9136-d3b01a4038b1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:33.819505 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6cc46180-39bf-4299-9136-d3b01a4038b1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:33.819996 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6cc46180-39bf-4299-9136-d3b01a4038b1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:34.035248 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6cc46180-39bf-4299-9136-d3b01a4038b1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:34.044107 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6cc46180-39bf-4299-9136-d3b01a4038b1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1573 microversion: 2.1 time: 0.238689 Feb 17 03:45:34.044701 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 754/1515] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:33 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1573 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:35.062171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f7c103c9-b662-4dcc-97e7-b66bb285473f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:35.062886 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f7c103c9-b662-4dcc-97e7-b66bb285473f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:35.070739 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7c103c9-b662-4dcc-97e7-b66bb285473f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:35.071251 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7c103c9-b662-4dcc-97e7-b66bb285473f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:35.072079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7c103c9-b662-4dcc-97e7-b66bb285473f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:35.072569 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f7c103c9-b662-4dcc-97e7-b66bb285473f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:35.283079 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f7c103c9-b662-4dcc-97e7-b66bb285473f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:35.292461 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f7c103c9-b662-4dcc-97e7-b66bb285473f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1573 microversion: 2.1 time: 0.234308 Feb 17 03:45:35.293080 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 762/1516] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:35 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1573 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:36.310912 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-29d61547-965e-4674-9cf5-b034b22b37cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:36.311500 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-29d61547-965e-4674-9cf5-b034b22b37cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:36.319311 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-29d61547-965e-4674-9cf5-b034b22b37cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:36.319817 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-29d61547-965e-4674-9cf5-b034b22b37cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:36.320636 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-29d61547-965e-4674-9cf5-b034b22b37cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:36.321167 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-29d61547-965e-4674-9cf5-b034b22b37cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:36.525832 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-29d61547-965e-4674-9cf5-b034b22b37cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:36.534603 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-29d61547-965e-4674-9cf5-b034b22b37cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1573 microversion: 2.1 time: 0.227787 Feb 17 03:45:36.535205 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 755/1517] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:36 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1573 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:37.552718 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5c941ced-eb6f-466f-8ae6-e1a0d1d77d9b tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:37.553407 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5c941ced-eb6f-466f-8ae6-e1a0d1d77d9b tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:37.561176 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5c941ced-eb6f-466f-8ae6-e1a0d1d77d9b tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:37.561678 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5c941ced-eb6f-466f-8ae6-e1a0d1d77d9b tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:37.562505 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5c941ced-eb6f-466f-8ae6-e1a0d1d77d9b tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:37.562995 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5c941ced-eb6f-466f-8ae6-e1a0d1d77d9b tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:37.771630 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5c941ced-eb6f-466f-8ae6-e1a0d1d77d9b tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:37.781150 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5c941ced-eb6f-466f-8ae6-e1a0d1d77d9b tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1573 microversion: 2.1 time: 0.232434 Feb 17 03:45:37.781745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 763/1518] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:37 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1573 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:38.799365 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e5ae2698-0b1a-4acd-95d9-2e5a69b315f2 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:38.800034 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e5ae2698-0b1a-4acd-95d9-2e5a69b315f2 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:38.807922 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5ae2698-0b1a-4acd-95d9-2e5a69b315f2 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:38.808491 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5ae2698-0b1a-4acd-95d9-2e5a69b315f2 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:38.809344 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5ae2698-0b1a-4acd-95d9-2e5a69b315f2 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:38.809833 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e5ae2698-0b1a-4acd-95d9-2e5a69b315f2 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:39.020789 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e5ae2698-0b1a-4acd-95d9-2e5a69b315f2 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:39.030710 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e5ae2698-0b1a-4acd-95d9-2e5a69b315f2 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1573 microversion: 2.1 time: 0.235424 Feb 17 03:45:39.031305 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 756/1519] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:38 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1573 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:40.049337 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-1fb70256-e3aa-4ec6-bdb6-74422c77e6b9 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:40.050007 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-1fb70256-e3aa-4ec6-bdb6-74422c77e6b9 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:40.058416 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1fb70256-e3aa-4ec6-bdb6-74422c77e6b9 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:40.058925 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1fb70256-e3aa-4ec6-bdb6-74422c77e6b9 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:40.059754 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1fb70256-e3aa-4ec6-bdb6-74422c77e6b9 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:40.060243 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-1fb70256-e3aa-4ec6-bdb6-74422c77e6b9 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:40.273551 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-1fb70256-e3aa-4ec6-bdb6-74422c77e6b9 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:40.282941 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-1fb70256-e3aa-4ec6-bdb6-74422c77e6b9 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1573 microversion: 2.1 time: 0.237668 Feb 17 03:45:40.283529 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 764/1520] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:40 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1573 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:40.965845 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:45:40.966027 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:45:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:45:41.301632 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5c5230e7-3d6b-4f32-96bb-c05092126889 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:41.302229 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5c5230e7-3d6b-4f32-96bb-c05092126889 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:41.309980 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5c5230e7-3d6b-4f32-96bb-c05092126889 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:41.310490 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5c5230e7-3d6b-4f32-96bb-c05092126889 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:41.311314 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5c5230e7-3d6b-4f32-96bb-c05092126889 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:41.311799 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5c5230e7-3d6b-4f32-96bb-c05092126889 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:41.525946 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5c5230e7-3d6b-4f32-96bb-c05092126889 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:41.535745 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5c5230e7-3d6b-4f32-96bb-c05092126889 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1573 microversion: 2.1 time: 0.238091 Feb 17 03:45:41.536339 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 757/1521] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:41 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1573 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:41.831162 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-8e7440df-258c-4771-a90a-eaad6b44a45f req-2dfde580-a0b4-48cf-940c-9741712f1873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f0161e-1beb-4d64-8821-74972840276b", "name": "network-vif-unplugged", "status": "completed", "tag": "39703cbb-7232-4287-b978-10f8d1e89e27"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:45:41.832757 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:45:41.832757 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:45:41.842031 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-8e7440df-258c-4771-a90a-eaad6b44a45f req-2dfde580-a0b4-48cf-940c-9741712f1873 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:41.842533 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-8e7440df-258c-4771-a90a-eaad6b44a45f req-2dfde580-a0b4-48cf-940c-9741712f1873 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:41.860665 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-8e7440df-258c-4771-a90a-eaad6b44a45f req-2dfde580-a0b4-48cf-940c-9741712f1873 service nova] Creating event network-vif-unplugged:39703cbb-7232-4287-b978-10f8d1e89e27 for instance 77f0161e-1beb-4d64-8821-74972840276b on hv-cinder-75994 Feb 17 03:45:41.866055 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-8e7440df-258c-4771-a90a-eaad6b44a45f req-2dfde580-a0b4-48cf-940c-9741712f1873 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095891 Feb 17 03:45:41.866842 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 765/1522] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:45:41 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:45:42.554195 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-f89897c2-517f-4882-96eb-faa023f0e1a7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:42.554864 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-f89897c2-517f-4882-96eb-faa023f0e1a7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:42.562589 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f89897c2-517f-4882-96eb-faa023f0e1a7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:42.563100 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f89897c2-517f-4882-96eb-faa023f0e1a7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:42.564014 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f89897c2-517f-4882-96eb-faa023f0e1a7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:42.564427 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-f89897c2-517f-4882-96eb-faa023f0e1a7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:42.772851 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-f89897c2-517f-4882-96eb-faa023f0e1a7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:42.782465 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-f89897c2-517f-4882-96eb-faa023f0e1a7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1514 microversion: 2.1 time: 0.232400 Feb 17 03:45:42.783059 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 758/1523] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:42 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:42.800423 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c8289562-5b81-4851-8b50-16b5c3e05380 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:45:42.801182 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c8289562-5b81-4851-8b50-16b5c3e05380 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:42.809303 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c8289562-5b81-4851-8b50-16b5c3e05380 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:42.809760 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c8289562-5b81-4851-8b50-16b5c3e05380 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:42.810599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c8289562-5b81-4851-8b50-16b5c3e05380 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:42.811096 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c8289562-5b81-4851-8b50-16b5c3e05380 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:42.961921 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c8289562-5b81-4851-8b50-16b5c3e05380 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "POST /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b/action" status: 202 len: 0 microversion: 2.1 time: 0.165986 Feb 17 03:45:42.962584 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 766/1524] 10.222.0.57 () {60 vars in 1268 bytes} [Wed Feb 17 03:45:42 2021] POST /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:45:42.971024 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-02092549-9ea5-4a7e-9958-ad359d057d73 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:42.971700 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-02092549-9ea5-4a7e-9958-ad359d057d73 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:42.979516 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-02092549-9ea5-4a7e-9958-ad359d057d73 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:42.980591 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-02092549-9ea5-4a7e-9958-ad359d057d73 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:42.981469 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-02092549-9ea5-4a7e-9958-ad359d057d73 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:42.982038 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-02092549-9ea5-4a7e-9958-ad359d057d73 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:43.196879 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-02092549-9ea5-4a7e-9958-ad359d057d73 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:43.206141 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-02092549-9ea5-4a7e-9958-ad359d057d73 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1522 microversion: 2.1 time: 0.239098 Feb 17 03:45:43.206738 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 759/1525] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:42 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:44.225172 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-88991297-74de-438f-aa61-dfb0abf98401 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:44.225842 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-88991297-74de-438f-aa61-dfb0abf98401 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:44.234177 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-88991297-74de-438f-aa61-dfb0abf98401 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:44.234682 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-88991297-74de-438f-aa61-dfb0abf98401 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:44.235505 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-88991297-74de-438f-aa61-dfb0abf98401 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:44.236008 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-88991297-74de-438f-aa61-dfb0abf98401 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:44.452061 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-88991297-74de-438f-aa61-dfb0abf98401 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:44.461527 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-88991297-74de-438f-aa61-dfb0abf98401 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1524 microversion: 2.1 time: 0.240371 Feb 17 03:45:44.462110 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 767/1526] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:44 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1524 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:45.481477 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c5406d32-ad58-40cd-99af-bac49873dcb7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:45.482072 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c5406d32-ad58-40cd-99af-bac49873dcb7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:45.489847 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c5406d32-ad58-40cd-99af-bac49873dcb7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:45.490358 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c5406d32-ad58-40cd-99af-bac49873dcb7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:45.491223 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c5406d32-ad58-40cd-99af-bac49873dcb7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:45.491686 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c5406d32-ad58-40cd-99af-bac49873dcb7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:45.707679 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c5406d32-ad58-40cd-99af-bac49873dcb7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:45.717289 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c5406d32-ad58-40cd-99af-bac49873dcb7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1524 microversion: 2.1 time: 0.241222 Feb 17 03:45:45.717875 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 760/1527] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:45 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1524 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:46.736070 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-9fe972fc-9ed6-483e-b682-70bd03b34407 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:46.736738 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-9fe972fc-9ed6-483e-b682-70bd03b34407 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:46.746704 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9fe972fc-9ed6-483e-b682-70bd03b34407 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:46.747209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9fe972fc-9ed6-483e-b682-70bd03b34407 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:46.748151 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9fe972fc-9ed6-483e-b682-70bd03b34407 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:46.748995 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-9fe972fc-9ed6-483e-b682-70bd03b34407 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:46.963864 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-9fe972fc-9ed6-483e-b682-70bd03b34407 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:46.973251 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-9fe972fc-9ed6-483e-b682-70bd03b34407 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1580 microversion: 2.1 time: 0.241278 Feb 17 03:45:46.973850 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 768/1528] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:46 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1580 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:47.992138 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-e159db75-176a-4248-8c90-2709951554bf tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:47.992797 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-e159db75-176a-4248-8c90-2709951554bf tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:48.000618 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e159db75-176a-4248-8c90-2709951554bf tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:48.001171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e159db75-176a-4248-8c90-2709951554bf tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:48.001999 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e159db75-176a-4248-8c90-2709951554bf tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:48.002482 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-e159db75-176a-4248-8c90-2709951554bf tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:48.208581 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-e159db75-176a-4248-8c90-2709951554bf tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:48.218114 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-e159db75-176a-4248-8c90-2709951554bf tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1580 microversion: 2.1 time: 0.230155 Feb 17 03:45:48.218707 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 761/1529] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:47 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1580 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:49.235637 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-5a8a214c-9126-4a8f-b22f-413ff51b656a tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:49.236230 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-5a8a214c-9126-4a8f-b22f-413ff51b656a tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:49.244183 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a8a214c-9126-4a8f-b22f-413ff51b656a tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:49.244703 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a8a214c-9126-4a8f-b22f-413ff51b656a tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:49.246041 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a8a214c-9126-4a8f-b22f-413ff51b656a tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:49.246525 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-5a8a214c-9126-4a8f-b22f-413ff51b656a tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:49.456897 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-5a8a214c-9126-4a8f-b22f-413ff51b656a tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:49.465740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-5a8a214c-9126-4a8f-b22f-413ff51b656a tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1580 microversion: 2.1 time: 0.234273 Feb 17 03:45:49.466335 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 769/1530] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:49 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1580 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:50.484299 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-01bb5f91-8d4d-42b1-8005-768b20ab116e tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:50.484966 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-01bb5f91-8d4d-42b1-8005-768b20ab116e tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:50.492737 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-01bb5f91-8d4d-42b1-8005-768b20ab116e tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:50.493275 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-01bb5f91-8d4d-42b1-8005-768b20ab116e tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:50.494101 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-01bb5f91-8d4d-42b1-8005-768b20ab116e tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:50.494584 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-01bb5f91-8d4d-42b1-8005-768b20ab116e tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:50.703867 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-01bb5f91-8d4d-42b1-8005-768b20ab116e tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:50.712689 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-01bb5f91-8d4d-42b1-8005-768b20ab116e tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1580 microversion: 2.1 time: 0.232876 Feb 17 03:45:50.713311 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 762/1531] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:50 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1580 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:51.732131 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-d03bbcad-be4c-4de8-aab8-34b1db9c139d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:51.732802 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-d03bbcad-be4c-4de8-aab8-34b1db9c139d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:51.740616 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d03bbcad-be4c-4de8-aab8-34b1db9c139d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:51.741159 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d03bbcad-be4c-4de8-aab8-34b1db9c139d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:51.742011 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d03bbcad-be4c-4de8-aab8-34b1db9c139d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:51.742504 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-d03bbcad-be4c-4de8-aab8-34b1db9c139d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:51.959334 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-d03bbcad-be4c-4de8-aab8-34b1db9c139d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:51.968193 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-d03bbcad-be4c-4de8-aab8-34b1db9c139d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1580 microversion: 2.1 time: 0.240610 Feb 17 03:45:51.968786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 770/1532] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:51 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1580 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:52.986938 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-805426a4-a6c4-4566-8627-0acd81ebc836 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:52.987741 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-805426a4-a6c4-4566-8627-0acd81ebc836 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:52.996003 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-805426a4-a6c4-4566-8627-0acd81ebc836 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:52.996497 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-805426a4-a6c4-4566-8627-0acd81ebc836 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:52.997367 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-805426a4-a6c4-4566-8627-0acd81ebc836 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:52.997848 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-805426a4-a6c4-4566-8627-0acd81ebc836 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:53.207330 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-805426a4-a6c4-4566-8627-0acd81ebc836 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:53.216108 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-805426a4-a6c4-4566-8627-0acd81ebc836 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1580 microversion: 2.1 time: 0.233219 Feb 17 03:45:53.216691 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 763/1533] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:52 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1580 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:54.234380 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-204ce105-8699-4bd7-a50f-8f53bea26cd1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:54.234976 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-204ce105-8699-4bd7-a50f-8f53bea26cd1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:54.242769 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-204ce105-8699-4bd7-a50f-8f53bea26cd1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:54.243273 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-204ce105-8699-4bd7-a50f-8f53bea26cd1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:54.244104 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-204ce105-8699-4bd7-a50f-8f53bea26cd1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:54.244599 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-204ce105-8699-4bd7-a50f-8f53bea26cd1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:54.452765 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-204ce105-8699-4bd7-a50f-8f53bea26cd1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:54.461673 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-204ce105-8699-4bd7-a50f-8f53bea26cd1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1580 microversion: 2.1 time: 0.231405 Feb 17 03:45:54.462267 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 771/1534] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:54 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1580 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:55.480551 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-c2665c0f-e564-410f-9851-c48e825b2890 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:55.481259 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-c2665c0f-e564-410f-9851-c48e825b2890 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:55.489067 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c2665c0f-e564-410f-9851-c48e825b2890 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:55.489609 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c2665c0f-e564-410f-9851-c48e825b2890 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:55.490449 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c2665c0f-e564-410f-9851-c48e825b2890 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:55.490947 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-c2665c0f-e564-410f-9851-c48e825b2890 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:55.701387 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-c2665c0f-e564-410f-9851-c48e825b2890 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:55.710182 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-c2665c0f-e564-410f-9851-c48e825b2890 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1580 microversion: 2.1 time: 0.234320 Feb 17 03:45:55.710754 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 764/1535] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:55 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1580 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:56.554254 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-08e79c23-1476-49a4-9b9c-6c3f9ba0ec94 req-961f223d-8a30-490b-a9eb-fd337c344533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f0161e-1beb-4d64-8821-74972840276b", "name": "network-vif-plugged", "status": "completed", "tag": "39703cbb-7232-4287-b978-10f8d1e89e27"}]} {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:45:56.556010 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:45:56.556010 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:45:56.565428 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-08e79c23-1476-49a4-9b9c-6c3f9ba0ec94 req-961f223d-8a30-490b-a9eb-fd337c344533 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:56.565924 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-08e79c23-1476-49a4-9b9c-6c3f9ba0ec94 req-961f223d-8a30-490b-a9eb-fd337c344533 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:56.583717 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-08e79c23-1476-49a4-9b9c-6c3f9ba0ec94 req-961f223d-8a30-490b-a9eb-fd337c344533 service nova] Creating event network-vif-plugged:39703cbb-7232-4287-b978-10f8d1e89e27 for instance 77f0161e-1beb-4d64-8821-74972840276b on hv-cinder-75994 Feb 17 03:45:56.588737 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-08e79c23-1476-49a4-9b9c-6c3f9ba0ec94 req-961f223d-8a30-490b-a9eb-fd337c344533 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038450 Feb 17 03:45:56.589434 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 772/1536] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:45:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:45:56.728050 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-6d2b6d59-b314-4fbd-a428-f8016cdbaa73 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:56.728710 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-6d2b6d59-b314-4fbd-a428-f8016cdbaa73 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:56.737458 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6d2b6d59-b314-4fbd-a428-f8016cdbaa73 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:56.737985 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6d2b6d59-b314-4fbd-a428-f8016cdbaa73 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:56.738822 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6d2b6d59-b314-4fbd-a428-f8016cdbaa73 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:56.739313 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-6d2b6d59-b314-4fbd-a428-f8016cdbaa73 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:56.959496 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-6d2b6d59-b314-4fbd-a428-f8016cdbaa73 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:56.968553 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-6d2b6d59-b314-4fbd-a428-f8016cdbaa73 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1580 microversion: 2.1 time: 0.244490 Feb 17 03:45:56.969166 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 765/1537] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:56 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1580 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:57.987864 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-b53833d3-1fe5-4568-8b06-e899773916bd tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:57.988649 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-b53833d3-1fe5-4568-8b06-e899773916bd tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:57.997360 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b53833d3-1fe5-4568-8b06-e899773916bd tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:57.997869 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b53833d3-1fe5-4568-8b06-e899773916bd tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:57.998732 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b53833d3-1fe5-4568-8b06-e899773916bd tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:57.999230 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-b53833d3-1fe5-4568-8b06-e899773916bd tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:58.216046 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-b53833d3-1fe5-4568-8b06-e899773916bd tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:58.225003 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-b53833d3-1fe5-4568-8b06-e899773916bd tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1580 microversion: 2.1 time: 0.241879 Feb 17 03:45:58.225616 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 773/1538] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:57 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1580 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:45:59.243012 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-7b7e45af-44c6-416b-b920-261f51683957 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:45:59.243608 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-7b7e45af-44c6-416b-b920-261f51683957 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:45:59.251438 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7b7e45af-44c6-416b-b920-261f51683957 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:59.251942 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7b7e45af-44c6-416b-b920-261f51683957 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:59.252765 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7b7e45af-44c6-416b-b920-261f51683957 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:45:59.253422 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-7b7e45af-44c6-416b-b920-261f51683957 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:45:59.463007 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-7b7e45af-44c6-416b-b920-261f51683957 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:45:59.472557 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-7b7e45af-44c6-416b-b920-261f51683957 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1567 microversion: 2.1 time: 0.233689 Feb 17 03:45:59.473164 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 766/1539] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:45:59 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:46:11.432279 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:46:11.433391 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:46:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:47:24.564024 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:47:24.564543 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:47:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:47:28.386616 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-59cc47ef-055a-4422-a113-625aa0c3d8ce tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '.version_select at 0x7f98aafc0950>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:47:29.375975 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-59cc47ef-055a-4422-a113-625aa0c3d8ce tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:47:29.384171 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-59cc47ef-055a-4422-a113-625aa0c3d8ce tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:47:29.384678 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-59cc47ef-055a-4422-a113-625aa0c3d8ce tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:47:29.385600 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-59cc47ef-055a-4422-a113-625aa0c3d8ce tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:47:29.386102 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-59cc47ef-055a-4422-a113-625aa0c3d8ce tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:47:29.449197 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-59cc47ef-055a-4422-a113-625aa0c3d8ce tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Acquired lock "refresh_cache-77f0161e-1beb-4d64-8821-74972840276b" {{(pid=98104) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 17 03:47:31.695083 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-59cc47ef-055a-4422-a113-625aa0c3d8ce tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Building network info cache for instance {{(pid=98104) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 17 03:47:31.767813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-be48461c-6cef-4ed7-995c-423c8f07f466 req-91fcac51-7237-4274-89e6-c8415dc8d878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f0161e-1beb-4d64-8821-74972840276b", "tag": "39703cbb-7232-4287-b978-10f8d1e89e27"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:47:31.770265 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:47:31.770265 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:47:31.780813 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-be48461c-6cef-4ed7-995c-423c8f07f466 req-91fcac51-7237-4274-89e6-c8415dc8d878 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:47:31.781361 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-be48461c-6cef-4ed7-995c-423c8f07f466 req-91fcac51-7237-4274-89e6-c8415dc8d878 service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:47:31.801883 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-be48461c-6cef-4ed7-995c-423c8f07f466 req-91fcac51-7237-4274-89e6-c8415dc8d878 service nova] Creating event network-changed:39703cbb-7232-4287-b978-10f8d1e89e27 for instance 77f0161e-1beb-4d64-8821-74972840276b on hv-cinder-75994 Feb 17 03:47:31.808715 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-be48461c-6cef-4ed7-995c-423c8f07f466 req-91fcac51-7237-4274-89e6-c8415dc8d878 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107591 Feb 17 03:47:31.810254 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 767/1540] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:47:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:47:33.021856 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.network.neutron [None req-59cc47ef-055a-4422-a113-625aa0c3d8ce tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Updating instance_info_cache with network_info: [{"id": "39703cbb-7232-4287-b978-10f8d1e89e27", "address": "fa:16:3e:bd:f3:78", "network": {"id": "6d75f49d-2a5f-4240-85a8-12f51dafc5ee", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288731035-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6d1987144d0f48bfb9d06f558ccc8618", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap39703cbb-72", "ovs_interfaceid": "39703cbb-7232-4287-b978-10f8d1e89e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98104) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 17 03:47:33.032634 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-59cc47ef-055a-4422-a113-625aa0c3d8ce tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Releasing lock "refresh_cache-77f0161e-1beb-4d64-8821-74972840276b" {{(pid=98104) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 17 03:47:33.033619 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-59cc47ef-055a-4422-a113-625aa0c3d8ce tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "DELETE /compute/v2.1/os-floating-ips/745fe921-b6cf-4544-a2f2-fe4bf14775e4" status: 202 len: 0 microversion: 2.1 time: 4.700234 Feb 17 03:47:33.034248 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 774/1541] 10.222.0.57 () {58 vars in 1253 bytes} [Wed Feb 17 03:47:28 2021] DELETE /compute/v2.1/os-floating-ips/745fe921-b6cf-4544-a2f2-fe4bf14775e4 => generated 0 bytes in 4701 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:47:33.043587 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-beed3ecb-3a42-40a2-8e8d-7bbbcba4bff1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:47:33.044234 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-beed3ecb-3a42-40a2-8e8d-7bbbcba4bff1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:47:33.052507 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-beed3ecb-3a42-40a2-8e8d-7bbbcba4bff1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:47:33.053009 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-beed3ecb-3a42-40a2-8e8d-7bbbcba4bff1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:47:33.053877 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-beed3ecb-3a42-40a2-8e8d-7bbbcba4bff1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:47:33.054361 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-beed3ecb-3a42-40a2-8e8d-7bbbcba4bff1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:47:33.120331 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-beed3ecb-3a42-40a2-8e8d-7bbbcba4bff1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Going to try to terminate instance {{(pid=98103) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 17 03:47:33.239191 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-beed3ecb-3a42-40a2-8e8d-7bbbcba4bff1 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "DELETE /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 204 len: 0 microversion: 2.1 time: 0.199812 Feb 17 03:47:33.239830 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 768/1542] 10.222.0.57 () {58 vars in 1229 bytes} [Wed Feb 17 03:47:33 2021] DELETE /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 17 03:47:33.249277 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-457be855-2c64-4e49-b3de-9381a8075b80 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:47:33.249952 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-457be855-2c64-4e49-b3de-9381a8075b80 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:47:33.257945 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-457be855-2c64-4e49-b3de-9381a8075b80 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:47:33.258454 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-457be855-2c64-4e49-b3de-9381a8075b80 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:47:33.259294 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-457be855-2c64-4e49-b3de-9381a8075b80 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:47:33.259793 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-457be855-2c64-4e49-b3de-9381a8075b80 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:47:33.488025 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-457be855-2c64-4e49-b3de-9381a8075b80 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:47:33.497376 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-457be855-2c64-4e49-b3de-9381a8075b80 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1455 microversion: 2.1 time: 0.252326 Feb 17 03:47:33.498165 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 775/1543] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:47:33 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1455 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:47:34.516424 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-eec4fc27-8867-4adb-ae5e-4a6fefa9842f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:47:34.517224 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-eec4fc27-8867-4adb-ae5e-4a6fefa9842f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:47:34.524943 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eec4fc27-8867-4adb-ae5e-4a6fefa9842f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:47:34.525487 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eec4fc27-8867-4adb-ae5e-4a6fefa9842f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:47:34.526314 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eec4fc27-8867-4adb-ae5e-4a6fefa9842f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:47:34.526803 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-eec4fc27-8867-4adb-ae5e-4a6fefa9842f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:47:34.743546 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-eec4fc27-8867-4adb-ae5e-4a6fefa9842f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:47:34.753126 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-eec4fc27-8867-4adb-ae5e-4a6fefa9842f tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1455 microversion: 2.1 time: 0.241894 Feb 17 03:47:34.753731 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 769/1544] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:47:34 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1455 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:47:35.772087 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-60852a63-66b2-4dcd-a8fa-f2ed32d9dc9a tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:47:35.772728 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-60852a63-66b2-4dcd-a8fa-f2ed32d9dc9a tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:47:35.780929 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-60852a63-66b2-4dcd-a8fa-f2ed32d9dc9a tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:47:35.781472 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-60852a63-66b2-4dcd-a8fa-f2ed32d9dc9a tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:47:35.782301 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-60852a63-66b2-4dcd-a8fa-f2ed32d9dc9a tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:47:35.782786 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-60852a63-66b2-4dcd-a8fa-f2ed32d9dc9a tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:47:36.179796 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-60852a63-66b2-4dcd-a8fa-f2ed32d9dc9a tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:47:36.188617 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-60852a63-66b2-4dcd-a8fa-f2ed32d9dc9a tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1455 microversion: 2.1 time: 0.420586 Feb 17 03:47:36.189483 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 776/1545] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:47:35 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1455 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:47:36.246209 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [req-1c52d7a8-e442-47a0-a5f9-6468fc68b311 req-1dc9135a-0fc4-47ed-82bb-afe15e7c6cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f0161e-1beb-4d64-8821-74972840276b", "name": "network-vif-deleted", "tag": "39703cbb-7232-4287-b978-10f8d1e89e27"}]} {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 17 03:47:36.248440 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 17 03:47:36.248440 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: warnings.warn(msg) Feb 17 03:47:36.257373 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-1c52d7a8-e442-47a0-a5f9-6468fc68b311 req-1dc9135a-0fc4-47ed-82bb-afe15e7c6cda service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:47:36.257879 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [req-1c52d7a8-e442-47a0-a5f9-6468fc68b311 req-1dc9135a-0fc4-47ed-82bb-afe15e7c6cda service nova] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:47:36.275715 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.compute.server_external_events [req-1c52d7a8-e442-47a0-a5f9-6468fc68b311 req-1dc9135a-0fc4-47ed-82bb-afe15e7c6cda service nova] Creating event network-vif-deleted:39703cbb-7232-4287-b978-10f8d1e89e27 for instance 77f0161e-1beb-4d64-8821-74972840276b on hv-cinder-75994 Feb 17 03:47:36.280740 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [req-1c52d7a8-e442-47a0-a5f9-6468fc68b311 req-1dc9135a-0fc4-47ed-82bb-afe15e7c6cda service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038799 Feb 17 03:47:36.281657 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 770/1546] 10.222.0.57 () {64 vars in 1308 bytes} [Wed Feb 17 03:47:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 17 03:47:37.206985 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-619c5fa0-60aa-4761-9d68-5df3b79491cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:47:37.207636 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-619c5fa0-60aa-4761-9d68-5df3b79491cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98104) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:47:37.216433 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-619c5fa0-60aa-4761-9d68-5df3b79491cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:47:37.217009 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-619c5fa0-60aa-4761-9d68-5df3b79491cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:47:37.217901 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-619c5fa0-60aa-4761-9d68-5df3b79491cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:47:37.218393 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-619c5fa0-60aa-4761-9d68-5df3b79491cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:47:37.293077 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-619c5fa0-60aa-4761-9d68-5df3b79491cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:47:37.293668 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-619c5fa0-60aa-4761-9d68-5df3b79491cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98104) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:47:37.294391 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.objects.instance [None req-619c5fa0-60aa-4761-9d68-5df3b79491cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lazy-loading 'fault' on Instance uuid 77f0161e-1beb-4d64-8821-74972840276b {{(pid=98104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 17 03:47:37.618045 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.policy [None req-619c5fa0-60aa-4761-9d68-5df3b79491cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a719e1785453bb422dcfe11f5817d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1987144d0f48bfb9d06f558ccc8618', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98104) authorize /opt/stack/nova/nova/policy.py:202}} Feb 17 03:47:37.628749 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-619c5fa0-60aa-4761-9d68-5df3b79491cb tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 200 len: 1179 microversion: 2.1 time: 0.425827 Feb 17 03:47:37.629563 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 777/1547] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:47:37 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 1179 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 17 03:47:38.648090 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8b0efde2-ece4-43d1-ac5a-0a36f698303d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:47:38.648865 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.compute.api [None req-8b0efde2-ece4-43d1-ac5a-0a36f698303d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [instance: 77f0161e-1beb-4d64-8821-74972840276b] Fetching instance by UUID {{(pid=98103) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 17 03:47:38.656891 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8b0efde2-ece4-43d1-ac5a-0a36f698303d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:47:38.657456 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8b0efde2-ece4-43d1-ac5a-0a36f698303d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:47:38.658337 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8b0efde2-ece4-43d1-ac5a-0a36f698303d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 17 03:47:38.658824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG oslo_concurrency.lockutils [None req-8b0efde2-ece4-43d1-ac5a-0a36f698303d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Lock "bb2942c0-ebf7-43c0-b475-e153b195efa7" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98103) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 17 03:47:38.712094 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.wsgi [None req-8b0efde2-ece4-43d1-ac5a-0a36f698303d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] HTTP exception thrown: Instance 77f0161e-1beb-4d64-8821-74972840276b could not be found. Feb 17 03:47:38.712758 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-8b0efde2-ece4-43d1-ac5a-0a36f698303d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Returning 404 to user: Instance 77f0161e-1beb-4d64-8821-74972840276b could not be found. {{(pid=98103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 17 03:47:38.713714 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-8b0efde2-ece4-43d1-ac5a-0a36f698303d tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b" status: 404 len: 111 microversion: 2.1 time: 0.070237 Feb 17 03:47:38.714309 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 771/1548] 10.222.0.57 () {58 vars in 1226 bytes} [Wed Feb 17 03:47:38 2021] GET /compute/v2.1/servers/77f0161e-1beb-4d64-8821-74972840276b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 17 03:47:38.723111 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-24391f82-08e6-44c1-ae85-698d7cc831e8 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '.version_select at 0x7f98b02997b8>' {{(pid=98104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:47:38.963739 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-24391f82-08e6-44c1-ae85-698d7cc831e8 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "DELETE /compute/v2.1/os-security-groups/c91227bb-43a5-40ff-bd7d-20adc312d046" status: 202 len: 0 microversion: 2.1 time: 0.244565 Feb 17 03:47:38.964371 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98104|app: 0|req: 778/1549] 10.222.0.57 () {58 vars in 1262 bytes} [Wed Feb 17 03:47:38 2021] DELETE /compute/v2.1/os-security-groups/c91227bb-43a5-40ff-bd7d-20adc312d046 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:47:38.973203 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: DEBUG nova.api.openstack.wsgi [None req-08bb64cb-3855-4ef2-8979-2d7549bfeda7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] Calling method '.version_select at 0x7f98b0149ae8>' {{(pid=98103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 17 03:47:38.976637 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: ERROR oslo.messaging._drivers.impl_rabbit [None req-08bb64cb-3855-4ef2-8979-2d7549bfeda7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [0972892e-dc20-4067-8a72-ccd3674cbdb9] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 17 03:47:39.992514 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [None req-08bb64cb-3855-4ef2-8979-2d7549bfeda7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] [0972892e-dc20-4067-8a72-ccd3674cbdb9] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 59768. Feb 17 03:47:40.010600 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO nova.api.openstack.requestlog [None req-08bb64cb-3855-4ef2-8979-2d7549bfeda7 tempest-TestShelveInstance-1617019077 tempest-TestShelveInstance-1617019077-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1251723052" status: 202 len: 0 microversion: 2.1 time: 1.041494 Feb 17 03:47:40.011238 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: [pid: 98103|app: 0|req: 772/1550] 10.222.0.57 () {58 vars in 1244 bytes} [Wed Feb 17 03:47:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1251723052 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 17 03:47:49.660870 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:47:49.661444 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:47:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:49:00.982933 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:49:00.983413 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:49:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:50:44.581715 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:50:44.582295 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:50:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:51:06.797661 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:51:06.798116 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:51:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:51:09.679415 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:51:09.679944 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:51:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:52:20.999824 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:52:21.000338 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:52:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:52:51.453356 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:52:51.454210 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:52:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 17 03:52:54.591279 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 17 03:52:54.591817 dv-cinder-759943-5-iscsi devstack@n-api.service[98101]: Wed Feb 17 03:52:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!